-- Logs begin at Mon 2022-08-29 18:13:03 UTC, end at Mon 2022-08-29 19:26:07 UTC. -- Aug 29 18:56:28.824861 dv-cinder-855013-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 18:56:28.832929 dv-cinder-855013-1-smb devstack@keystone.service[81867]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 18:56:28 2022] *** Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: nodename: dv-cinder-855013-1-smb Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: machine: x86_64 Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: clock source: unix Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: pcre jit disabled Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: detected number of CPU cores: 4 Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: current working directory: / Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: detected binary path: /usr/bin/uwsgi-core Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: your processes number limit is 47680 Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: your memory page size is 4096 bytes Aug 29 18:56:28.836202 dv-cinder-855013-1-smb devstack@keystone.service[81867]: detected max file descriptor number: 2048 Aug 29 18:56:28.836939 dv-cinder-855013-1-smb devstack@keystone.service[81867]: lock engine: pthread robust mutexes Aug 29 18:56:28.836939 dv-cinder-855013-1-smb devstack@keystone.service[81867]: thunder lock: enabled Aug 29 18:56:28.836939 dv-cinder-855013-1-smb devstack@keystone.service[81867]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 18:56:28.836939 dv-cinder-855013-1-smb devstack@keystone.service[81867]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 18:56:28.880316 dv-cinder-855013-1-smb devstack@keystone.service[81867]: Python main interpreter initialized at 0x55f1474019c0 Aug 29 18:56:28.880316 dv-cinder-855013-1-smb devstack@keystone.service[81867]: python threads support enabled Aug 29 18:56:28.880316 dv-cinder-855013-1-smb devstack@keystone.service[81867]: your server socket listen backlog is limited to 100 connections Aug 29 18:56:28.880316 dv-cinder-855013-1-smb devstack@keystone.service[81867]: your mercy for graceful operations on workers is 90 seconds Aug 29 18:56:28.880726 dv-cinder-855013-1-smb devstack@keystone.service[81867]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 18:56:28.880726 dv-cinder-855013-1-smb devstack@keystone.service[81867]: *** Operational MODE: preforking *** Aug 29 18:56:28.881011 dv-cinder-855013-1-smb devstack@keystone.service[81867]: *** uWSGI is running in multiple interpreter mode *** Aug 29 18:56:28.881011 dv-cinder-855013-1-smb devstack@keystone.service[81867]: spawned uWSGI master process (pid: 81867) Aug 29 18:56:28.881223 dv-cinder-855013-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 18:56:28.884151 dv-cinder-855013-1-smb devstack@keystone.service[81867]: spawned uWSGI worker 1 (pid: 81882, cores: 1) Aug 29 18:56:28.884388 dv-cinder-855013-1-smb devstack@keystone.service[81867]: spawned uWSGI worker 2 (pid: 81883, cores: 1) Aug 29 18:56:28.884553 dv-cinder-855013-1-smb devstack@keystone.service[81867]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 18:56:33.324792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:56:33.324792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: from cryptography.utils import int_from_bytes Aug 29 18:56:33.325598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:56:33.325598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: from cryptography.utils import int_from_bytes Aug 29 18:56:33.325736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:56:33.325736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: from cryptography.utils import int_from_bytes Aug 29 18:56:33.326169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:56:33.326169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: from cryptography.utils import int_from_bytes Aug 29 18:56:33.378383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 18:56:33.378663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 18:56:33.378796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] command line args: [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 18:56:33.379001 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 18:56:33.379178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ================================================================================ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 18:56:33.379434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] admin_token = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.379678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] config_dir = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.379889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.380070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] config_source = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.380250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] debug = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.380458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.380831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.381120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.381874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.382414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.382414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.382845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] log_config_append = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.382845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.382845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] log_dir = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.383618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] log_file = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.383618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.383618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.384491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.384491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.384491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.384491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.384491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.384979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.384979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.385207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.385290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 18:56:33.385445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.385532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 18:56:33.385651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] command line args: [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 18:56:33.385759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.386117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 18:56:33.386243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.386342 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ================================================================================ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 18:56:33.386444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.386546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] admin_token = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.386648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.386757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_dir = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.386757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.386945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] config_source = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.82/identity {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387148 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] debug = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] publish_errors = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.387985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] standard_threads = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_config_append = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.388944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_dir = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] use_journal = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] use_json = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] use_stderr = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] use_syslog = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.389961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.390032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.390181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.390249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.390358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.390448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.390583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.390715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.390939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.391007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.391179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.391273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.391415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.391496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.391649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.391743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.396599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.396727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.396798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.396862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.396948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.397050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.397177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.397287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.397400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.397400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.397684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.82/identity {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.397684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] publish_errors = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.397847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.397908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.397971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.398030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.398169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.398232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.398290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.398347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.398403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.398460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.398524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.398584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] standard_threads = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.398648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.398706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.398763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.398825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.398825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.398944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_journal = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.399071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_json = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.399130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_stderr = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.399243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] use_syslog = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.399366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:56:33.399500 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.399901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.400924 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401725 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.401842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402890 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.402958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403650 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.403955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.404984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.405133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.405225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.405367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.405467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.405603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.405713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.405833 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.405946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.406063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.406217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.406300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.406456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.406543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.406705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.406781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.407270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.407367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.407367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.407575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.407675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.407808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.407944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.408953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.409898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.410015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.410134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.410223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.410369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.410501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.410606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.410690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.410838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.411948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.412033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.412107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.412316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.412469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.412590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.412792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.413069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.413225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.413352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.413544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.413628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.413755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.413864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.413947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.414109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.414231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.414400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.414534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.414645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.414968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.415093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.415191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.415316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.415400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.415470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.415647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.415755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.external = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.415914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416009 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.password = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.416948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] auth.token = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.417110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.417181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.418048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.418191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.418318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.418466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.418599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.418734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.418857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.418995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.419122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.419259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.419390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.419515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.419637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.419794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.419950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.420083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.420214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.420350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.420477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.420603 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.420741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.420877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.421006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.421142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.421268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.421398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.421526 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.421677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.421800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.421937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.422065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.422193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.422321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.422450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.422587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.422587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.422879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.external = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.423992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.424120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.424120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.424381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.424381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.424622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.424750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.password = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.424877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.425011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] auth.token = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.425139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.425265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.425393 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.425521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.425654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.425782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.425916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.426057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.426184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.426310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.426522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.426681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.426840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.426969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.427904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.428525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.428604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.430886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.431951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432687 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.432905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.433993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.434962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435496 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.435983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436345 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.436956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437334 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437807 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.437982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.438131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.438222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.438373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.438464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.438630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.438718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.438860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.438948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.439104 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.439191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.439347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.439437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.439579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.439668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.439846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.439936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.440996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.441078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.441236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.441317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.441477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.441562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.441711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.441793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.441949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442030 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442345 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442653 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.442945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.443112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.443193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.443349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.443433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.443625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.444303 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.444415 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.444661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.444770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.444918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.445096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.445180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.445348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.445430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.445613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.445695 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.445851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.445934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.446089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.446170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.446577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.446659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.446817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.446901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.447051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.447131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.447282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.447364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.447566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.447810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.447810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.448117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.448198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.448272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.448387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.448519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.448654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.448821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.449975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] role.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] role.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.450931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.451999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.452155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.452237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.452392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.452476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.452623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.452705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.452857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.452938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.453088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.453237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.453320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.453481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.453563 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.453714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.453804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.453952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.454035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.454191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.454441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.454522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.454687 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.454770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.454923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.455047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.455171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.455261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.455422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.455510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.455658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.455870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.455955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456030 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456149 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.456950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.457095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.457177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.457329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.457410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.457580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.457662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.457827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.457909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.458074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.458163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.458313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.458396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.458547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.458629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.458779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.458911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.459016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] token.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.459099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.459331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.459416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.459595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.459751 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.459894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.460071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.460202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.460320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.460405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.460570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.460681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.460927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.461075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.461207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.461336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.461472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.461606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.461735 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.461863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.462002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.462089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.462213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.462342 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.462479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.462609 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.462739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.462866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.463925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.464010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.464130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.464405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.469898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.469989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.470967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.471983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81882) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.472507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.473637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:56:33.474062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81883) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 18:56:33.498236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.498466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.498691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.498982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.499220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.499450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.508029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.508478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.536693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.536949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.537922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.538153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.600628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.600827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.653140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.653390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.654346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.654580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.814003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.814236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.814459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.814679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.814898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.815112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.815199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.815351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.815576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.815821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.816039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.816254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.841360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.841584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.841775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.841901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842332 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.842891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.843108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.862120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.863062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.875252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.875487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.875653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.875863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.875949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.876024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.876173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.876259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.876433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.876617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.876705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81883) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.876780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.876853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.877028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81882) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 18:56:33.899746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.900024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 18:56:33.900266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.900359 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.900485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 18:56:33.900664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 18:56:33.900843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.900954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.901087 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 18:56:33.901305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.901489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.901585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.901765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.901850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.902036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.902118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.911492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.911801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.912033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.912119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.912372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.912469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.934645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.934645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.934842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.934922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.934998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.934998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.934998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.935267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.935400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.935508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.935601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.935677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.935765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.935840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.935913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.935983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.936632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.949313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.949656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.950745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.951034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.951159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.951450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.955800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.956059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.956144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.956353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.956435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.956644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.963254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.963553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.963813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.964107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.967650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.967973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.968107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.968259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.968427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.968547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.968835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.968942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.969111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.969305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.969471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.970237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.971284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.972272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.972574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.972875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.987411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.987703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.988875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.989169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.992062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.993280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:33.995348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.995674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.996602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:33.996890 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.000143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.001264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.003409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.004454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.007273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.007576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.007890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.008121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.008207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.008428 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.008513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.008721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.008808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.009014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.009300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.009691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.025127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.025422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.025693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.025961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.026257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.026562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.026840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.027115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.033082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.033971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.036794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.036910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.036981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.036981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.037609 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.037609 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.039497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.039815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.040213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.040298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.040505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.040603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.040795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.040878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.041083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.041383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.052029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.052320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.052712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.052811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.053141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.053229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.053332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.053487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.053712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.053787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.053897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.054074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.054184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.054488 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.070047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.070487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.073212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.073811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.076213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.076746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.077658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.078205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.079285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.079574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.079686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.079886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.080009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.080300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.087014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.087361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.088525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.088866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.091497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.091779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.091904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.092075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.092366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.092366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.092517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.092640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.100435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.100659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.100776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.101144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.101634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.101714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.107998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81882) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.108182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81883) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 18:56:34.108273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.108474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.108560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.108761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.108855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.109044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.109128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.109324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.109408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.109603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.109695 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.109884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.109967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.110163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.110253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.110434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.110518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.110716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.110797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.111014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.111235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.111414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.111718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.111718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.112174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81882) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.112410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81883) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 18:56:34.146497 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1474019c0 pid: 81883 (default app) Aug 29 18:56:34.147524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f1474019c0 pid: 81882 (default app) Aug 29 18:56:34.151148 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a60b8-f17c-4698-9610-250e1fb7d66f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:34.151482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a60b8-f17c-4698-9610-250e1fb7d66f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:34.151839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a60b8-f17c-4698-9610-250e1fb7d66f None None] PATH_INFO: `/v3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:34.156083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 791 bytes} [Mon Aug 29 18:56:34 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:41.842032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bab01-313b-4dd7-b3e1-336141e00480 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:41.842557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bab01-313b-4dd7-b3e1-336141e00480 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:41.842557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bab01-313b-4dd7-b3e1-336141e00480 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:41.846884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1/2] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:56:41.852240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:41.852670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:41.852793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:41.923283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: INFO dbcounter [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] Registered counter for database keystone Aug 29 18:56:41.942989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG oslo_db.sqlalchemy.engines [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81883) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:56:41.950365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writer thread running {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:56:42.130790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG passlib.handlers.bcrypt [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81883) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 18:56:42.131226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG passlib.handlers.bcrypt [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81883) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 18:56:42.190648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:42.192281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:42.321096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 2/3] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 18:56:42.822679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bab01-313b-4dd7-b3e1-336141e00480 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:42.891853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: INFO dbcounter [None req-c95bab01-313b-4dd7-b3e1-336141e00480 None None] Registered counter for database keystone Aug 29 18:56:42.913981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG oslo_db.sqlalchemy.engines [None req-c95bab01-313b-4dd7-b3e1-336141e00480 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81882) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:56:42.920253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writer thread running {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:56:43.041009 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bab01-313b-4dd7-b3e1-336141e00480 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:43.045280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68498b3a-332d-4c4b-ad67-d6d72fb585a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:43.045903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498b3a-332d-4c4b-ad67-d6d72fb585a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:43.046189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498b3a-332d-4c4b-ad67-d6d72fb585a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:43.046467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68498b3a-332d-4c4b-ad67-d6d72fb585a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:43.054599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68498b3a-332d-4c4b-ad67-d6d72fb585a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:43.107515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING keystone.common.rbac_enforcer.enforcer [None req-68498b3a-332d-4c4b-ad67-d6d72fb585a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 18:56:43.107822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68498b3a-332d-4c4b-ad67-d6d72fb585a0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:43.121741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 2/4] 10.222.0.82 () {58 vars in 1324 bytes} [Mon Aug 29 18:56:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 18:56:43.127823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:43.143939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91336d-fa40-4353-837d-bcfe88290076 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:43.148684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1ef83-eae4-4a91-9dce-364e751e0a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:43.149867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ef83-eae4-4a91-9dce-364e751e0a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:43.150183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ef83-eae4-4a91-9dce-364e751e0a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:43.153107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1ef83-eae4-4a91-9dce-364e751e0a1c admin admin] PATH_INFO: `/v3/projects/6563c9a51480471196235c4b00b7535a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:43.153107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1ef83-eae4-4a91-9dce-364e751e0a1c admin admin] RBAC: Authorizing `identity:get_project(project_id=6563c9a51480471196235c4b00b7535a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:43.206331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2eb1ef83-eae4-4a91-9dce-364e751e0a1c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 18:56:43.206684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1ef83-eae4-4a91-9dce-364e751e0a1c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:43.211423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 3/5] 10.222.0.82 () {56 vars in 1207 bytes} [Mon Aug 29 18:56:43 2022] GET /identity/v3/projects/6563c9a51480471196235c4b00b7535a => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:45.106292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a54ef-4884-4f1b-968a-7f44ee1a07ad None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:45.106895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a54ef-4884-4f1b-968a-7f44ee1a07ad None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:45.106895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a54ef-4884-4f1b-968a-7f44ee1a07ad None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:45.110958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 3/6] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:56:45.117088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee3f1-f6e6-43f8-8a2e-8452fb59cc0d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:45.117517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee3f1-f6e6-43f8-8a2e-8452fb59cc0d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:45.117653 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbee3f1-f6e6-43f8-8a2e-8452fb59cc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:45.137621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bfbee3f1-f6e6-43f8-8a2e-8452fb59cc0d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:45.139145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bfbee3f1-f6e6-43f8-8a2e-8452fb59cc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:45.147568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 4/7] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 18:56:45.422343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a54ef-4884-4f1b-968a-7f44ee1a07ad None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:45.434522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a54ef-4884-4f1b-968a-7f44ee1a07ad None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:45.439060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cb864-8bf0-4357-a535-7730bb482d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:45.445244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb864-8bf0-4357-a535-7730bb482d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:45.445244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb864-8bf0-4357-a535-7730bb482d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:45.445244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb864-8bf0-4357-a535-7730bb482d26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:45.448679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cb864-8bf0-4357-a535-7730bb482d26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:45.450462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cb864-8bf0-4357-a535-7730bb482d26 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:45.460010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 4/8] 10.222.0.82 () {58 vars in 1324 bytes} [Mon Aug 29 18:56:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 18:56:45.465832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee3f1-f6e6-43f8-8a2e-8452fb59cc0d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:45.475860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbee3f1-f6e6-43f8-8a2e-8452fb59cc0d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:45.480216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cf7ff-1ae5-4382-b2aa-b898962ddb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:45.480845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf7ff-1ae5-4382-b2aa-b898962ddb43 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:45.481129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf7ff-1ae5-4382-b2aa-b898962ddb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:45.481409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf7ff-1ae5-4382-b2aa-b898962ddb43 admin admin] PATH_INFO: `/v3/users/094bda4debcf4532ab8f582465d0a41a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:45.482731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cf7ff-1ae5-4382-b2aa-b898962ddb43 admin admin] RBAC: Authorizing `identity:get_user(user_id=094bda4debcf4532ab8f582465d0a41a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:45.484611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239cf7ff-1ae5-4382-b2aa-b898962ddb43 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:45.486148 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 5/9] 10.222.0.82 () {56 vars in 1198 bytes} [Mon Aug 29 18:56:45 2022] GET /identity/v3/users/094bda4debcf4532ab8f582465d0a41a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:47.503135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0fbf3-781e-4e6b-a46d-32b16374fe19 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:47.503687 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700de9e-6a1b-442e-9dc3-df0d7adf9aad None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:47.504071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0fbf3-781e-4e6b-a46d-32b16374fe19 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:47.504163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700de9e-6a1b-442e-9dc3-df0d7adf9aad None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:47.504255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0fbf3-781e-4e6b-a46d-32b16374fe19 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:47.504340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700de9e-6a1b-442e-9dc3-df0d7adf9aad None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:47.505005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 5/10] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:56:47.505950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 6/11] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:56:47.510484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:47.510768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:47.511035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57933ea7-04da-4f8a-8f38-ede8c0aef112 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:47.511134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:47.511329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57933ea7-04da-4f8a-8f38-ede8c0aef112 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:47.511607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57933ea7-04da-4f8a-8f38-ede8c0aef112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:47.529893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-57933ea7-04da-4f8a-8f38-ede8c0aef112 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:47.531072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-57933ea7-04da-4f8a-8f38-ede8c0aef112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:47.552330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG passlib.handlers.bcrypt [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81882) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 18:56:47.552771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG passlib.handlers.bcrypt [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81882) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 18:56:47.602504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:47.604145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:47.612537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 7/12] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:56:47.706236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 6/13] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:56:47.891370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57933ea7-04da-4f8a-8f38-ede8c0aef112 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:47.915930 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:47.970132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:48.000651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57933ea7-04da-4f8a-8f38-ede8c0aef112 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:48.038033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9860b-be17-4d27-a5f7-35bb0b94030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:48.038675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9860b-be17-4d27-a5f7-35bb0b94030f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:48.038972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9860b-be17-4d27-a5f7-35bb0b94030f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:48.039254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd9860b-be17-4d27-a5f7-35bb0b94030f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:48.050286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd9860b-be17-4d27-a5f7-35bb0b94030f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5cd9860b-be17-4d27-a5f7-35bb0b94030f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:56:48.059952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:56:48.060976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:56:48.061918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 8/14] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:56:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:56:48.066804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9860b-be17-4d27-a5f7-35bb0b94030f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:48.071874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c4fff-de90-49c2-80c4-0e8721fca261 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:48.074207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:48.109243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879bf37-4514-461c-824a-a7554117421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:48.110100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879bf37-4514-461c-824a-a7554117421b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:48.110387 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879bf37-4514-461c-824a-a7554117421b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:48.110662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879bf37-4514-461c-824a-a7554117421b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:48.153038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:48.170887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd9860b-be17-4d27-a5f7-35bb0b94030f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:48.180826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879bf37-4514-461c-824a-a7554117421b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:48.182353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879bf37-4514-461c-824a-a7554117421b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:48.206312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:48.206926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:48.207212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:48.207485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:48.208973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:56:48.209484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:48.210619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:48.222315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 9/15] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:48.227976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:48.284124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 7/16] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:56:48.289835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879bf37-4514-461c-824a-a7554117421b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:48.292690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:48.329046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff954c9-b286-41a6-8fb9-f8db5c1caa02 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:48.362642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc71a2-0174-4454-991a-3ade451b63ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:48.363270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc71a2-0174-4454-991a-3ade451b63ec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:48.363549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc71a2-0174-4454-991a-3ade451b63ec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:48.363850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc71a2-0174-4454-991a-3ade451b63ec None admin] PATH_INFO: `/v3/users/094bda4debcf4532ab8f582465d0a41a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:48.365874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc71a2-0174-4454-991a-3ade451b63ec None admin] RBAC: Authorizing `identity:get_user(user_id=094bda4debcf4532ab8f582465d0a41a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:48.367334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc71a2-0174-4454-991a-3ade451b63ec None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:48.368948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 10/17] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:56:48 2022] GET /identity/v3/users/094bda4debcf4532ab8f582465d0a41a => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:48.374445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc71a2-0174-4454-991a-3ade451b63ec None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:48.387141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879bf37-4514-461c-824a-a7554117421b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:48.389658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:48.420929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:48.421702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:48.421982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:48.422254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:48.440816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:48.442279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:56:48.461955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:56:48.462917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:56:48.463771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:56:48.463771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:56:48.463771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:56:48.463771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 8/18] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:56:48.468855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:48.476432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc71a2-0174-4454-991a-3ade451b63ec None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:48.510392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d0586-095e-4eb9-afcc-26d0f2bb92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:48.511339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d0586-095e-4eb9-afcc-26d0f2bb92b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:48.511632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d0586-095e-4eb9-afcc-26d0f2bb92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:48.511941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d0586-095e-4eb9-afcc-26d0f2bb92b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:48.513073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d0586-095e-4eb9-afcc-26d0f2bb92b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:48.514537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d0586-095e-4eb9-afcc-26d0f2bb92b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:48.516129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 11/19] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:48.522340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d0586-095e-4eb9-afcc-26d0f2bb92b5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:48.528128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:48.575027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23442420-6877-4bdf-aa4e-f076dfbe9144 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:48.607004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:48.612124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2578b25-4b26-4f48-b885-af154c4dec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:48.612802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578b25-4b26-4f48-b885-af154c4dec84 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:48.613089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578b25-4b26-4f48-b885-af154c4dec84 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:48.613365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2578b25-4b26-4f48-b885-af154c4dec84 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:48.614017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2578b25-4b26-4f48-b885-af154c4dec84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:56:48.614326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2578b25-4b26-4f48-b885-af154c4dec84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:48.616064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2578b25-4b26-4f48-b885-af154c4dec84 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:48.626701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d0586-095e-4eb9-afcc-26d0f2bb92b5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:48.633964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 9/20] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:48.665676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d9b03-0e5b-4e2f-aa65-e76e70610857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:48.666308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9b03-0e5b-4e2f-aa65-e76e70610857 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:48.666588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9b03-0e5b-4e2f-aa65-e76e70610857 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:48.666861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d9b03-0e5b-4e2f-aa65-e76e70610857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:48.667608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d9b03-0e5b-4e2f-aa65-e76e70610857 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.domain.id=default, user.id=094bda4debcf4532ab8f582465d0a41a) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:56:48.667950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d9b03-0e5b-4e2f-aa65-e76e70610857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:48.669518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d9b03-0e5b-4e2f-aa65-e76e70610857 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:48.677269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 12/21] 10.222.0.82 () {56 vars in 1322 bytes} [Mon Aug 29 18:56:48 2022] GET /identity/v3/role_assignments?user.id=094bda4debcf4532ab8f582465d0a41a&scope.domain.id=default&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:50.820556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fb096-76b4-44f1-9e2f-fa36b37d7eb7 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:50.821834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fb096-76b4-44f1-9e2f-fa36b37d7eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:50.822331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8fb096-76b4-44f1-9e2f-fa36b37d7eb7 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:50.824191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 10/22] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:56:50.829914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cba90a-332b-4c70-9cfd-35c73de5f940 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:50.830702 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cba90a-332b-4c70-9cfd-35c73de5f940 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:50.831178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cba90a-332b-4c70-9cfd-35c73de5f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:50.860754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a5cba90a-332b-4c70-9cfd-35c73de5f940 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:50.862306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a5cba90a-332b-4c70-9cfd-35c73de5f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:50.940346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b538e0-d005-4c7b-a260-618750a65447 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:50.940965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b538e0-d005-4c7b-a260-618750a65447 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:50.941438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b538e0-d005-4c7b-a260-618750a65447 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:50.943848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 11/23] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:56:50.949672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dcdcd-a01b-4ff2-8590-b1f1d444e9da None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:50.950237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dcdcd-a01b-4ff2-8590-b1f1d444e9da None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:50.950733 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90dcdcd-a01b-4ff2-8590-b1f1d444e9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:50.969423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 13/24] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:56:50.982336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d90dcdcd-a01b-4ff2-8590-b1f1d444e9da None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:50.983934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d90dcdcd-a01b-4ff2-8590-b1f1d444e9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:51.086421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 12/25] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:56:51.319086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df62775-e74f-4c09-a205-a9d8d3f58fe6 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:51.319372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df62775-e74f-4c09-a205-a9d8d3f58fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:51.319875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df62775-e74f-4c09-a205-a9d8d3f58fe6 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:51.321972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 14/26] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:56:51.326886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4dc6e-67ec-4e91-bcce-c1408b29f9a4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:51.327353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4dc6e-67ec-4e91-bcce-c1408b29f9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:51.327805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4dc6e-67ec-4e91-bcce-c1408b29f9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:51.352820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f1c4dc6e-67ec-4e91-bcce-c1408b29f9a4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:51.354320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f1c4dc6e-67ec-4e91-bcce-c1408b29f9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:51.404994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:51.433456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 13/27] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:56:51.460428 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df62775-e74f-4c09-a205-a9d8d3f58fe6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:51.584407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:51.617260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df62775-e74f-4c09-a205-a9d8d3f58fe6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:51.670928 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:51.671569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:51.676319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:51.676319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:51.683120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4dc6e-67ec-4e91-bcce-c1408b29f9a4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:51.699802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:51.701698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:56:51.729661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:56:51.730558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:56:51.731423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:56:51.731423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:56:51.731423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:56:51.731423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 15/28] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:56:51.736598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:51.877019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4dc6e-67ec-4e91-bcce-c1408b29f9a4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:51.931833 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41182d4a-2243-41ae-abe0-7295ffd347d5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:51.943556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bc0f5-dcbb-4818-b745-504bff4dcb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:51.944232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bc0f5-dcbb-4818-b745-504bff4dcb40 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:51.944515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bc0f5-dcbb-4818-b745-504bff4dcb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:51.944784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bc0f5-dcbb-4818-b745-504bff4dcb40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:51.957365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bc0f5-dcbb-4818-b745-504bff4dcb40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:56:51.959557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e84bc0f5-dcbb-4818-b745-504bff4dcb40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:56:51.965697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:56:51.966806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:56:51.967759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:56:51.970212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 14/29] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:56:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:56:51.970354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:51.971026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:51.971845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b9969-9242-41bf-bbb5-3129ab56a36b None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:51.972249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b9969-9242-41bf-bbb5-3129ab56a36b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:51.974584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b9969-9242-41bf-bbb5-3129ab56a36b None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:51.974584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 15/30] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:56:51.975518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b9969-9242-41bf-bbb5-3129ab56a36b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:51.979214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:51.979214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:51.979214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:56:51.979214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:51.979214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:51.999910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 16/31] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:52.000750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:52.023675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:52.117144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b9969-9242-41bf-bbb5-3129ab56a36b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:52.118189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d4fad-fe50-4346-bbec-181794811b2e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:52.157793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a06e72-202a-4547-8dde-d8999af44b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:52.158486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a06e72-202a-4547-8dde-d8999af44b2f None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.158770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a06e72-202a-4547-8dde-d8999af44b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.159044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a06e72-202a-4547-8dde-d8999af44b2f None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.160014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a06e72-202a-4547-8dde-d8999af44b2f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:52.162897 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a06e72-202a-4547-8dde-d8999af44b2f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:52.166642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aed6c-c6f5-462f-bb72-65a92fe6fc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:52.167715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aed6c-c6f5-462f-bb72-65a92fe6fc15 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.168192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aed6c-c6f5-462f-bb72-65a92fe6fc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.168617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aed6c-c6f5-462f-bb72-65a92fe6fc15 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.170150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aed6c-c6f5-462f-bb72-65a92fe6fc15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:56:52.170607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aed6c-c6f5-462f-bb72-65a92fe6fc15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:52.172397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aed6c-c6f5-462f-bb72-65a92fe6fc15 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:52.186614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 17/32] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:56:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:52.186614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6b97-9f9d-4988-a5c2-565e52b7018a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.186614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6b97-9f9d-4988-a5c2-565e52b7018a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.186614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf6b97-9f9d-4988-a5c2-565e52b7018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.203072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cdcf6b97-9f9d-4988-a5c2-565e52b7018a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:52.204464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cdcf6b97-9f9d-4988-a5c2-565e52b7018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:52.256965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:52.287048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 18/33] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:56:52.287048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6b97-9f9d-4988-a5c2-565e52b7018a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:52.414299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 16/34] 10.222.0.82 () {60 vars in 1131 bytes} [Mon Aug 29 18:56:51 2022] POST /identity/v3/roles => generated 225 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:56:52.415264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a06e72-202a-4547-8dde-d8999af44b2f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:52.547813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf6b97-9f9d-4988-a5c2-565e52b7018a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:52.562125 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:52.569133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a06e72-202a-4547-8dde-d8999af44b2f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:52.608392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dd447-be77-4b06-8104-d2667db913ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:52.609119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dd447-be77-4b06-8104-d2667db913ed None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.609404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dd447-be77-4b06-8104-d2667db913ed None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.609705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dd447-be77-4b06-8104-d2667db913ed None admin] PATH_INFO: `/v3/users/094bda4debcf4532ab8f582465d0a41a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.611445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dd447-be77-4b06-8104-d2667db913ed None admin] RBAC: Authorizing `identity:get_user(user_id=094bda4debcf4532ab8f582465d0a41a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:52.613129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dd447-be77-4b06-8104-d2667db913ed None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:52.616665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 17/35] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:56:52 2022] GET /identity/v3/users/094bda4debcf4532ab8f582465d0a41a => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:52.618099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1b17-82e8-4d3e-8373-906cdc3c6708 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.618099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1b17-82e8-4d3e-8373-906cdc3c6708 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.618099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1b17-82e8-4d3e-8373-906cdc3c6708 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.619051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 18/36] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:56:52.620210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76ee4f-7bdd-44dd-b11b-2dea2f58e503 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.620498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76ee4f-7bdd-44dd-b11b-2dea2f58e503 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.620777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76ee4f-7bdd-44dd-b11b-2dea2f58e503 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.622052 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 19/37] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:56:52.622791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76ee4f-7bdd-44dd-b11b-2dea2f58e503 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:52.637959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4acb4-9212-48d3-9148-162fd35029c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:52.638596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4acb4-9212-48d3-9148-162fd35029c0 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.638883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4acb4-9212-48d3-9148-162fd35029c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.639163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4acb4-9212-48d3-9148-162fd35029c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.639863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4acb4-9212-48d3-9148-162fd35029c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:52.641365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4acb4-9212-48d3-9148-162fd35029c0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:52.735486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76ee4f-7bdd-44dd-b11b-2dea2f58e503 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:52.769608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97299e-cca7-49fb-be3d-738e7e8b1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:52.770224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97299e-cca7-49fb-be3d-738e7e8b1748 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.771070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97299e-cca7-49fb-be3d-738e7e8b1748 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.773306 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97299e-cca7-49fb-be3d-738e7e8b1748 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.776933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97299e-cca7-49fb-be3d-738e7e8b1748 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:52.777060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97299e-cca7-49fb-be3d-738e7e8b1748 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:52.839775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 20/38] 10.222.0.82 () {60 vars in 1131 bytes} [Mon Aug 29 18:56:52 2022] POST /identity/v3/roles => generated 219 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:56:52.841072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf90637-cf87-4f0a-9590-1e6b0b56eb9f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.841365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf90637-cf87-4f0a-9590-1e6b0b56eb9f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.841641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf90637-cf87-4f0a-9590-1e6b0b56eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.867346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6cf90637-cf87-4f0a-9590-1e6b0b56eb9f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:52.869077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6cf90637-cf87-4f0a-9590-1e6b0b56eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:52.890865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:52.932061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 19/39] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:56:52 2022] POST /identity/v3/projects => generated 301 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:56:52.941157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4acb4-9212-48d3-9148-162fd35029c0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:52.960441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 21/40] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:56:52.961935 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1d873-ef39-4d5a-ab79-dc4bc7a8dbf5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:52.962350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1d873-ef39-4d5a-ab79-dc4bc7a8dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:52.962634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1d873-ef39-4d5a-ab79-dc4bc7a8dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:52.998895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-23e1d873-ef39-4d5a-ab79-dc4bc7a8dbf5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:52.999968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-23e1d873-ef39-4d5a-ab79-dc4bc7a8dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:53.035476 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:53.090907 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 22/41] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:56:53.140155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4acb4-9212-48d3-9148-162fd35029c0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:53.179255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07030d0-0481-4380-a485-99a68bf45bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:53.179942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07030d0-0481-4380-a485-99a68bf45bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:53.180233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07030d0-0481-4380-a485-99a68bf45bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:53.180514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07030d0-0481-4380-a485-99a68bf45bd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:53.181852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07030d0-0481-4380-a485-99a68bf45bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:53.183424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07030d0-0481-4380-a485-99a68bf45bd1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:53.185174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 20/42] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:56:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:53.191153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1d873-ef39-4d5a-ab79-dc4bc7a8dbf5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:53.256056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07030d0-0481-4380-a485-99a68bf45bd1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:53.288676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:53.308270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1d873-ef39-4d5a-ab79-dc4bc7a8dbf5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:53.346866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5688-3e3f-4aae-9122-70f17480f95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:53.347542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5688-3e3f-4aae-9122-70f17480f95b None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:53.348269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5688-3e3f-4aae-9122-70f17480f95b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:53.348622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b5688-3e3f-4aae-9122-70f17480f95b None admin] PATH_INFO: `/v3/domains/default/users/094bda4debcf4532ab8f582465d0a41a/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:53.350995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b5688-3e3f-4aae-9122-70f17480f95b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=094bda4debcf4532ab8f582465d0a41a, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:53.352521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b5688-3e3f-4aae-9122-70f17480f95b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:53.357561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:53.361643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07030d0-0481-4380-a485-99a68bf45bd1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:53.395169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4f69e-d071-4ab7-a9e7-0b8844195a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:53.396396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f69e-d071-4ab7-a9e7-0b8844195a7f None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:53.396792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f69e-d071-4ab7-a9e7-0b8844195a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:53.397073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4f69e-d071-4ab7-a9e7-0b8844195a7f None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:53.397747 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4f69e-d071-4ab7-a9e7-0b8844195a7f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:53.399139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4f69e-d071-4ab7-a9e7-0b8844195a7f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:53.471811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 23/43] 10.222.0.82 () {58 vars in 1361 bytes} [Mon Aug 29 18:56:53 2022] PUT /identity/v3/domains/default/users/094bda4debcf4532ab8f582465d0a41a/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:56:53.472731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5688-3e3f-4aae-9122-70f17480f95b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:53.502665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 21/44] 10.222.0.82 () {60 vars in 1131 bytes} [Mon Aug 29 18:56:53 2022] POST /identity/v3/roles => generated 223 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:56:53.600512 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b5688-3e3f-4aae-9122-70f17480f95b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:53.646313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd512c21-98f6-4b8d-93bf-61f80f623d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:53.647067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512c21-98f6-4b8d-93bf-61f80f623d80 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:53.647356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512c21-98f6-4b8d-93bf-61f80f623d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:53.647631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd512c21-98f6-4b8d-93bf-61f80f623d80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:53.648843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd512c21-98f6-4b8d-93bf-61f80f623d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:53.650314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd512c21-98f6-4b8d-93bf-61f80f623d80 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:53.652138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 24/45] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:56:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:53.657724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4f69e-d071-4ab7-a9e7-0b8844195a7f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:53.765564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4f69e-d071-4ab7-a9e7-0b8844195a7f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:53.801727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1150f-9461-40bb-9ba1-2a7e5496dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:53.802352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1150f-9461-40bb-9ba1-2a7e5496dc63 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:53.802642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1150f-9461-40bb-9ba1-2a7e5496dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:53.802926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1150f-9461-40bb-9ba1-2a7e5496dc63 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:53.803595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1150f-9461-40bb-9ba1-2a7e5496dc63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:53.805105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1150f-9461-40bb-9ba1-2a7e5496dc63 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:53.903170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 22/46] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:56:53 2022] POST /identity/v3/projects => generated 312 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:56:55.429472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8cb9e-df2a-4a22-9035-7eeaed24d3d8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:55.429999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8cb9e-df2a-4a22-9035-7eeaed24d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:55.430154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8cb9e-df2a-4a22-9035-7eeaed24d3d8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:55.431362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 25/47] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:56:55.436719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaecc8-74bb-485b-8847-a36457e63755 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:55.437168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaecc8-74bb-485b-8847-a36457e63755 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:55.437353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aaecc8-74bb-485b-8847-a36457e63755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:55.457353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-46aaecc8-74bb-485b-8847-a36457e63755 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:55.459494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-46aaecc8-74bb-485b-8847-a36457e63755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:55.462538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:55.529195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 23/48] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:56:55.804980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8cb9e-df2a-4a22-9035-7eeaed24d3d8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:55.822168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:55.826860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f626-6b16-4633-8290-a6668f24bc40 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:55.827169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f626-6b16-4633-8290-a6668f24bc40 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:55.827453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9f626-6b16-4633-8290-a6668f24bc40 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:55.828849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 24/49] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:56:55.835463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209a0c-10fd-48ba-b4f1-c3c6eaec7520 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:55.835775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209a0c-10fd-48ba-b4f1-c3c6eaec7520 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:55.837288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b209a0c-10fd-48ba-b4f1-c3c6eaec7520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:55.853882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0b209a0c-10fd-48ba-b4f1-c3c6eaec7520 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:55.855058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0b209a0c-10fd-48ba-b4f1-c3c6eaec7520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:55.914800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe8cb9e-df2a-4a22-9035-7eeaed24d3d8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:55.921314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 25/50] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:56:55.950097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75535-46c8-4b07-8cdd-311773530c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:55.950734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75535-46c8-4b07-8cdd-311773530c79 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:55.951022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75535-46c8-4b07-8cdd-311773530c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:55.951301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75535-46c8-4b07-8cdd-311773530c79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:55.961347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f75535-46c8-4b07-8cdd-311773530c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-77f75535-46c8-4b07-8cdd-311773530c79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:56:55.966271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:56:55.967142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:56:55.967936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 26/51] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:56:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:56:55.973295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209a0c-10fd-48ba-b4f1-c3c6eaec7520 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:56.040769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:56.072322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b209a0c-10fd-48ba-b4f1-c3c6eaec7520 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:56.106426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:56.107035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:56.107322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:56.107602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:56.108322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:56:56.108634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:56.110029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:56.118621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 26/52] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:56.124354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75535-46c8-4b07-8cdd-311773530c79 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:56.188963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:56.198156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:56.228498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75535-46c8-4b07-8cdd-311773530c79 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:56.263570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb4f5f-d21d-42ad-af22-c29e9af9c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:56.264264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4f5f-d21d-42ad-af22-c29e9af9c258 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:56.264550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4f5f-d21d-42ad-af22-c29e9af9c258 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:56.264828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb4f5f-d21d-42ad-af22-c29e9af9c258 None admin] PATH_INFO: `/v3/users/094bda4debcf4532ab8f582465d0a41a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:56.265967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb4f5f-d21d-42ad-af22-c29e9af9c258 None admin] RBAC: Authorizing `identity:get_user(user_id=094bda4debcf4532ab8f582465d0a41a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:56.267420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb4f5f-d21d-42ad-af22-c29e9af9c258 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:56.269045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 27/53] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:56:56 2022] GET /identity/v3/users/094bda4debcf4532ab8f582465d0a41a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:56.275348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb4f5f-d21d-42ad-af22-c29e9af9c258 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:56.296013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f29b4-2a5b-4bec-a45e-efbe5c959a82 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:56.325226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:56.330439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4773f-7876-47d5-a9dc-dd493eef0e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:56.331080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4773f-7876-47d5-a9dc-dd493eef0e55 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:56.331370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4773f-7876-47d5-a9dc-dd493eef0e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:56.331652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4773f-7876-47d5-a9dc-dd493eef0e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:56.332991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4773f-7876-47d5-a9dc-dd493eef0e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:56.334556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4773f-7876-47d5-a9dc-dd493eef0e55 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:56.337216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 27/54] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:56:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:56.341937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4773f-7876-47d5-a9dc-dd493eef0e55 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:56.375568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb4f5f-d21d-42ad-af22-c29e9af9c258 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:56.448621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4773f-7876-47d5-a9dc-dd493eef0e55 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:56.484816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a9d16-500d-4cd7-b88d-8aa73b5133fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:56.485934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9d16-500d-4cd7-b88d-8aa73b5133fa None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:56.486223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9d16-500d-4cd7-b88d-8aa73b5133fa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:56.486501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a9d16-500d-4cd7-b88d-8aa73b5133fa None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:56.487160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a9d16-500d-4cd7-b88d-8aa73b5133fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:56.489998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a9d16-500d-4cd7-b88d-8aa73b5133fa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:56.513531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35151e8-d027-4071-b15d-9312a67d35df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:56.514167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35151e8-d027-4071-b15d-9312a67d35df None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:56.514450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35151e8-d027-4071-b15d-9312a67d35df None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:56.514722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35151e8-d027-4071-b15d-9312a67d35df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:56.515842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35151e8-d027-4071-b15d-9312a67d35df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:56.517375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35151e8-d027-4071-b15d-9312a67d35df None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:56.518952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 28/55] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:56:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:56.525265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35151e8-d027-4071-b15d-9312a67d35df None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:56.536628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:56.621479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35151e8-d027-4071-b15d-9312a67d35df None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:56.653330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260e7d9-b2bb-4207-962b-a410e5a49586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:56.653940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e7d9-b2bb-4207-962b-a410e5a49586 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:56.654222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e7d9-b2bb-4207-962b-a410e5a49586 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:56.654495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260e7d9-b2bb-4207-962b-a410e5a49586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:56.655218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e7d9-b2bb-4207-962b-a410e5a49586 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.domain.id=default, user.id=094bda4debcf4532ab8f582465d0a41a) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:56:56.655525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e7d9-b2bb-4207-962b-a410e5a49586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:56.656377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 28/56] 10.222.0.82 () {60 vars in 1140 bytes} [Mon Aug 29 18:56:56 2022] POST /identity/v3/projects => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:56:56.656986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260e7d9-b2bb-4207-962b-a410e5a49586 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:56.665894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 29/57] 10.222.0.82 () {56 vars in 1322 bytes} [Mon Aug 29 18:56:56 2022] GET /identity/v3/role_assignments?user.id=094bda4debcf4532ab8f582465d0a41a&scope.domain.id=default&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:56:58.599697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fd80-13a0-495e-bc41-027fcdf8592c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:58.600233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fd80-13a0-495e-bc41-027fcdf8592c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:58.600350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fd80-13a0-495e-bc41-027fcdf8592c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:58.601653 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 29/58] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:56:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:56:58.606842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba7dc-ab60-4898-a95f-e7fffd13d8c2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:58.607254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba7dc-ab60-4898-a95f-e7fffd13d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:58.607398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ba7dc-ab60-4898-a95f-e7fffd13d8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:58.625494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b34ba7dc-ab60-4898-a95f-e7fffd13d8c2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:56:58.626672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b34ba7dc-ab60-4898-a95f-e7fffd13d8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:56:58.689931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 30/59] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:56:58.963260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2fd80-13a0-495e-bc41-027fcdf8592c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:59.015798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:59.063379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2fd80-13a0-495e-bc41-027fcdf8592c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:59.096496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fc110-1e3e-4bdb-ae67-5631e4016ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:59.097127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc110-1e3e-4bdb-ae67-5631e4016ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:59.097416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc110-1e3e-4bdb-ae67-5631e4016ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:59.097698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fc110-1e3e-4bdb-ae67-5631e4016ea2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:59.099391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fc110-1e3e-4bdb-ae67-5631e4016ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:59.100883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2fc110-1e3e-4bdb-ae67-5631e4016ea2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:59.102454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 30/60] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:56:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:56:59.108060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ba7dc-ab60-4898-a95f-e7fffd13d8c2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:56:59.110222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:56:59.204542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ba7dc-ab60-4898-a95f-e7fffd13d8c2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:56:59.238629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452e436-e528-4de5-9955-13161e8ade7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:56:59.239374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452e436-e528-4de5-9955-13161e8ade7c None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:56:59.239664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452e436-e528-4de5-9955-13161e8ade7c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:56:59.239975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452e436-e528-4de5-9955-13161e8ade7c None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:56:59.240639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452e436-e528-4de5-9955-13161e8ade7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:56:59.242074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452e436-e528-4de5-9955-13161e8ade7c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:56:59.363018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 31/61] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:56:59 2022] POST /identity/v3/users => generated 275 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:57:02.185586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a000-5590-4e0a-a2c7-5ee820a159a2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:02.186775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a000-5590-4e0a-a2c7-5ee820a159a2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:02.187266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28a000-5590-4e0a-a2c7-5ee820a159a2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:02.189137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 31/62] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:02.194100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139368b-828a-4457-97d1-e7e6dbfcff15 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:02.194919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139368b-828a-4457-97d1-e7e6dbfcff15 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:02.195811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139368b-828a-4457-97d1-e7e6dbfcff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:02.217477 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5139368b-828a-4457-97d1-e7e6dbfcff15 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:02.218689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5139368b-828a-4457-97d1-e7e6dbfcff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:02.277624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:02.303103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 32/63] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:02.702317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159968-95cf-4684-9a8a-c6e9a2275070 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:02.702838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159968-95cf-4684-9a8a-c6e9a2275070 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:02.703263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7159968-95cf-4684-9a8a-c6e9a2275070 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:02.704800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 32/64] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:02.710588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873482-1b93-48f3-8f23-31bd05e4c028 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:02.711050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873482-1b93-48f3-8f23-31bd05e4c028 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:02.711468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1873482-1b93-48f3-8f23-31bd05e4c028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:02.731408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c1873482-1b93-48f3-8f23-31bd05e4c028 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:02.732884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1873482-1b93-48f3-8f23-31bd05e4c028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:02.777697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7159968-95cf-4684-9a8a-c6e9a2275070 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:02.821348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 33/65] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:02.892221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aa969-d033-4d43-a2bf-49b72cefde97 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:02.892848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aa969-d033-4d43-a2bf-49b72cefde97 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:02.893320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88aa969-d033-4d43-a2bf-49b72cefde97 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:02.894886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 34/66] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:02.900247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3a3e3-eb6b-430a-8e35-4c543a11698f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:02.900777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3a3e3-eb6b-430a-8e35-4c543a11698f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:02.901415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3a3e3-eb6b-430a-8e35-4c543a11698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:02.932144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-74e3a3e3-eb6b-430a-8e35-4c543a11698f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:02.933671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-74e3a3e3-eb6b-430a-8e35-4c543a11698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:02.953347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7159968-95cf-4684-9a8a-c6e9a2275070 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:02.990710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:03.009618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18c7d-3755-468e-92d6-583ba404da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.010762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18c7d-3755-468e-92d6-583ba404da80 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.011195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18c7d-3755-468e-92d6-583ba404da80 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.011647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a18c7d-3755-468e-92d6-583ba404da80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.026631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a18c7d-3755-468e-92d6-583ba404da80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:03.028451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 35/67] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:03.029962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083574-7468-45a9-8038-bc7cfe891748 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.030445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083574-7468-45a9-8038-bc7cfe891748 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.030936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083574-7468-45a9-8038-bc7cfe891748 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.037378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 36/68] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:03.038745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdf89b-3470-443e-978d-40f9e87a20d1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.039244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdf89b-3470-443e-978d-40f9e87a20d1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.039716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cdf89b-3470-443e-978d-40f9e87a20d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-55a18c7d-3755-468e-92d6-583ba404da80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:03.040556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:03.041354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:03.042097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 33/69] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:03.050543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18c7d-3755-468e-92d6-583ba404da80 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.081407 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b9cdf89b-3470-443e-978d-40f9e87a20d1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:03.083245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b9cdf89b-3470-443e-978d-40f9e87a20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:03.142414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:03.174722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 37/70] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:03.175867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdf89b-3470-443e-978d-40f9e87a20d1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.214999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a18c7d-3755-468e-92d6-583ba404da80 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:03.254487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54831bd1-b75a-4735-82ea-f803a3fc751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.255364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831bd1-b75a-4735-82ea-f803a3fc751e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.255899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831bd1-b75a-4735-82ea-f803a3fc751e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.256324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54831bd1-b75a-4735-82ea-f803a3fc751e None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.257143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54831bd1-b75a-4735-82ea-f803a3fc751e None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:03.257599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54831bd1-b75a-4735-82ea-f803a3fc751e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:03.259358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54831bd1-b75a-4735-82ea-f803a3fc751e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:03.268918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 34/71] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:03.271384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b2868-798b-4ef5-93ab-0f2fb31d3b37 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.271891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b2868-798b-4ef5-93ab-0f2fb31d3b37 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.272318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b2868-798b-4ef5-93ab-0f2fb31d3b37 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.274293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 35/72] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:03.275091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b2868-798b-4ef5-93ab-0f2fb31d3b37 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.327953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:03.330535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cdf89b-3470-443e-978d-40f9e87a20d1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:03.374011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bd500-c13c-4a41-8833-7813df9b8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.374663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bd500-c13c-4a41-8833-7813df9b8c9b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.374951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bd500-c13c-4a41-8833-7813df9b8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.375233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bd500-c13c-4a41-8833-7813df9b8c9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.386781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bd500-c13c-4a41-8833-7813df9b8c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:03.389223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b2868-798b-4ef5-93ab-0f2fb31d3b37 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f96bd500-c13c-4a41-8833-7813df9b8c9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:03.391722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:03.392573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:03.393737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 38/73] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:03.400330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd298-9e86-494b-961a-d68cacc6bf36 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.400621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd298-9e86-494b-961a-d68cacc6bf36 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.400902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09fd298-9e86-494b-961a-d68cacc6bf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.418673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a09fd298-9e86-494b-961a-d68cacc6bf36 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:03.419911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a09fd298-9e86-494b-961a-d68cacc6bf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:03.430363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac85f1c-4661-4dcd-9aff-aaa238e127bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.430902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac85f1c-4661-4dcd-9aff-aaa238e127bd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.431186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac85f1c-4661-4dcd-9aff-aaa238e127bd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.431465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac85f1c-4661-4dcd-9aff-aaa238e127bd None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.445779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac85f1c-4661-4dcd-9aff-aaa238e127bd None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:03.447238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac85f1c-4661-4dcd-9aff-aaa238e127bd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:03.449072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 36/74] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:03.451543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:03.452744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac85f1c-4661-4dcd-9aff-aaa238e127bd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.491776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 39/75] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:03.498242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fd298-9e86-494b-961a-d68cacc6bf36 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.567338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:03.570756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac85f1c-4661-4dcd-9aff-aaa238e127bd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:03.607331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a7b8e-3057-41bc-bed4-b337220bcbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.608009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a7b8e-3057-41bc-bed4-b337220bcbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.608298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a7b8e-3057-41bc-bed4-b337220bcbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.608577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a7b8e-3057-41bc-bed4-b337220bcbb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.614411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09fd298-9e86-494b-961a-d68cacc6bf36 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:03.619275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a7b8e-3057-41bc-bed4-b337220bcbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-766a7b8e-3057-41bc-bed4-b337220bcbb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:03.624205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:03.625044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:03.625799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 37/76] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:03.626943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a7b8e-3057-41bc-bed4-b337220bcbb8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.656437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.657299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.657733 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.658179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.658994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:03.659468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:03.661651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:03.674914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 40/77] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:03.676070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.710230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:03.736690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a7b8e-3057-41bc-bed4-b337220bcbb8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:03.773513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca602-e6a9-4d34-a868-7a9784e4551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.774044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca602-e6a9-4d34-a868-7a9784e4551c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.774326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca602-e6a9-4d34-a868-7a9784e4551c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.774602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ca602-e6a9-4d34-a868-7a9784e4551c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.781956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb196d5-65c9-4f71-ac1b-51234feb7e06 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:03.804509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:03.817402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b39a74-c7eb-4505-a31c-d810ee2d2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.818037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39a74-c7eb-4505-a31c-d810ee2d2d0a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.818341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39a74-c7eb-4505-a31c-d810ee2d2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.828025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b39a74-c7eb-4505-a31c-d810ee2d2d0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.828920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b39a74-c7eb-4505-a31c-d810ee2d2d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-49b39a74-c7eb-4505-a31c-d810ee2d2d0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:03.834288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:03.835161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:03.835944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 41/78] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:03.836578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b39a74-c7eb-4505-a31c-d810ee2d2d0a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.844003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ca602-e6a9-4d34-a868-7a9784e4551c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:03.845498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ca602-e6a9-4d34-a868-7a9784e4551c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:03.928089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:03.937371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b39a74-c7eb-4505-a31c-d810ee2d2d0a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:03.944302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 38/79] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:03.949699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca602-e6a9-4d34-a868-7a9784e4551c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:03.971883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:03.972583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:03.973388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:03.974599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:03.974599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:03.974968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:03.976663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:03.985121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 42/80] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:03.985937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.006125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:04.045903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ca602-e6a9-4d34-a868-7a9784e4551c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.079201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0392c7b-4548-4e5b-8ec1-9d03aad497fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.079871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0392c7b-4548-4e5b-8ec1-9d03aad497fd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.080164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0392c7b-4548-4e5b-8ec1-9d03aad497fd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.080444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0392c7b-4548-4e5b-8ec1-9d03aad497fd None admin] PATH_INFO: `/v3/users/094bda4debcf4532ab8f582465d0a41a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.081574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0392c7b-4548-4e5b-8ec1-9d03aad497fd None admin] RBAC: Authorizing `identity:get_user(user_id=094bda4debcf4532ab8f582465d0a41a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.083640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0392c7b-4548-4e5b-8ec1-9d03aad497fd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.084052 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7933e3a-bfe0-41f7-af91-6b59efe25ebc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.085247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 39/81] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/users/094bda4debcf4532ab8f582465d0a41a => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:04.086021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0392c7b-4548-4e5b-8ec1-9d03aad497fd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.121809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5249b8f-cb03-49a0-ac4c-b47a91767556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.122440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5249b8f-cb03-49a0-ac4c-b47a91767556 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.122722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5249b8f-cb03-49a0-ac4c-b47a91767556 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.122995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5249b8f-cb03-49a0-ac4c-b47a91767556 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.124123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5249b8f-cb03-49a0-ac4c-b47a91767556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.125578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5249b8f-cb03-49a0-ac4c-b47a91767556 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.127102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 43/82] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:04.127888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5249b8f-cb03-49a0-ac4c-b47a91767556 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.156047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:04.186062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0392c7b-4548-4e5b-8ec1-9d03aad497fd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.218659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:04.227761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.228393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.228683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.228964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.229631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:04.229948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.231339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.239459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5249b8f-cb03-49a0-ac4c-b47a91767556 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.239939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 40/83] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:04.240747 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.277738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a14d1-0c86-4a77-a307-2e0d2985f3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.278385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a14d1-0c86-4a77-a307-2e0d2985f3bc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.278669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a14d1-0c86-4a77-a307-2e0d2985f3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.278948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a14d1-0c86-4a77-a307-2e0d2985f3bc None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.280117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a14d1-0c86-4a77-a307-2e0d2985f3bc None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.281569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a14d1-0c86-4a77-a307-2e0d2985f3bc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.283210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 44/84] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:04 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:04.284008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a14d1-0c86-4a77-a307-2e0d2985f3bc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.343776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac5d6-8761-49d6-b22d-e5eefb741bfd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.372346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:04.379193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4597df-543e-402d-a3b5-9aee5677d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.384461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4597df-543e-402d-a3b5-9aee5677d005 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.384461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4597df-543e-402d-a3b5-9aee5677d005 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.384461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4597df-543e-402d-a3b5-9aee5677d005 None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.384461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4597df-543e-402d-a3b5-9aee5677d005 None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.384461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4597df-543e-402d-a3b5-9aee5677d005 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.384801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 41/85] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:04 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:04.385491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4597df-543e-402d-a3b5-9aee5677d005 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.386079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a14d1-0c86-4a77-a307-2e0d2985f3bc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.421821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ef756-4074-45e3-8873-fce6e43fb28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.422562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef756-4074-45e3-8873-fce6e43fb28c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.422918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef756-4074-45e3-8873-fce6e43fb28c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.423265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ef756-4074-45e3-8873-fce6e43fb28c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.445508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:04.486876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4597df-543e-402d-a3b5-9aee5677d005 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.491619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ef756-4074-45e3-8873-fce6e43fb28c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.493128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ef756-4074-45e3-8873-fce6e43fb28c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.521554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9deae-1459-48a2-ad3a-16742e544e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.522174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9deae-1459-48a2-ad3a-16742e544e8a None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.522461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9deae-1459-48a2-ad3a-16742e544e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.522744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9deae-1459-48a2-ad3a-16742e544e8a None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.523404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9deae-1459-48a2-ad3a-16742e544e8a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.524875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9deae-1459-48a2-ad3a-16742e544e8a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.577898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:04.589985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 45/86] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:04.590792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ef756-4074-45e3-8873-fce6e43fb28c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.619165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 42/87] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:04 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:04.619165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9deae-1459-48a2-ad3a-16742e544e8a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.707746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ef756-4074-45e3-8873-fce6e43fb28c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.734431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9deae-1459-48a2-ad3a-16742e544e8a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.747534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca926bcc-1603-4e65-aed2-61b246b04867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.748218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926bcc-1603-4e65-aed2-61b246b04867 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.748501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926bcc-1603-4e65-aed2-61b246b04867 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.748776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca926bcc-1603-4e65-aed2-61b246b04867 None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.749927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca926bcc-1603-4e65-aed2-61b246b04867 None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.751016 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:04.751364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca926bcc-1603-4e65-aed2-61b246b04867 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.753025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 46/88] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:04 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:04.753789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca926bcc-1603-4e65-aed2-61b246b04867 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.781007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.781803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.781909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.782173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:04.783109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] RBAC: Adding query filter params (role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=370870b74de0407a9d8619b669b6f45f, user.id=00371932fc0e4504a658ef41b1609571) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:04.783213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:04.784780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:04.792293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 43/89] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:04 2022] GET /identity/v3/role_assignments?user.id=00371932fc0e4504a658ef41b1609571&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=cf033ca534d941b5b3284c687e715647 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:04.796011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:04.823117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:04.890144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca926bcc-1603-4e65-aed2-61b246b04867 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.943814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba4f14-3d9a-4f10-b37b-58bad47d5c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:04.944761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba4f14-3d9a-4f10-b37b-58bad47d5c88 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:04.945214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba4f14-3d9a-4f10-b37b-58bad47d5c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:04.945766 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f77ab-ff83-4b1d-a6b8-b70bb1824425 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:04.946046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba4f14-3d9a-4f10-b37b-58bad47d5c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:05.001381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d9e72-52e5-4409-b5ac-36ac461d2de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:05.002027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d9e72-52e5-4409-b5ac-36ac461d2de5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:05.002311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d9e72-52e5-4409-b5ac-36ac461d2de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:05.002589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d9e72-52e5-4409-b5ac-36ac461d2de5 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:05.004328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d9e72-52e5-4409-b5ac-36ac461d2de5 None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:05.006230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5d9e72-52e5-4409-b5ac-36ac461d2de5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:05.008801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 44/90] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:04 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:05.012560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d9e72-52e5-4409-b5ac-36ac461d2de5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:05.057169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba4f14-3d9a-4f10-b37b-58bad47d5c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:05.058837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba4f14-3d9a-4f10-b37b-58bad47d5c88 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:05.085215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:05.140913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:05.161722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5d9e72-52e5-4409-b5ac-36ac461d2de5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:05.223759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 47/91] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:05.224790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba4f14-3d9a-4f10-b37b-58bad47d5c88 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:05.232612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e485e90-0b9e-4eac-ae23-d9ee8b050053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:05.233247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e485e90-0b9e-4eac-ae23-d9ee8b050053 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:05.233539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e485e90-0b9e-4eac-ae23-d9ee8b050053 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:05.233887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e485e90-0b9e-4eac-ae23-d9ee8b050053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:05.323549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e485e90-0b9e-4eac-ae23-d9ee8b050053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:05.325070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e485e90-0b9e-4eac-ae23-d9ee8b050053 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:05.393131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:05.435615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba4f14-3d9a-4f10-b37b-58bad47d5c88 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:05.462974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 45/92] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:05.468154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e485e90-0b9e-4eac-ae23-d9ee8b050053 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:05.579453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e485e90-0b9e-4eac-ae23-d9ee8b050053 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:05.617497 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c40e-5b08-43d6-aa53-68582bb106ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:05.618166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c40e-5b08-43d6-aa53-68582bb106ce None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:05.618454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c40e-5b08-43d6-aa53-68582bb106ce None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:05.618735 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44c40e-5b08-43d6-aa53-68582bb106ce None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:05.619711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:05.619933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c40e-5b08-43d6-aa53-68582bb106ce None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:05.620355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:05.620647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:05.620931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:05.621444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44c40e-5b08-43d6-aa53-68582bb106ce None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:05.621680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=370870b74de0407a9d8619b669b6f45f, user.id=094bda4debcf4532ab8f582465d0a41a) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:05.623255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 46/93] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:05 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:05.623977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c40e-5b08-43d6-aa53-68582bb106ce None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:05.628137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:05.629820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:05.642518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 48/94] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:05 2022] GET /identity/v3/role_assignments?user.id=094bda4debcf4532ab8f582465d0a41a&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 259 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:05.643244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:05.656083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:05.727109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:05.789730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44c40e-5b08-43d6-aa53-68582bb106ce None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:05.872498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202ab1-4868-4bcd-a220-dbff81819b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:05.873168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202ab1-4868-4bcd-a220-dbff81819b4d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:05.873454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202ab1-4868-4bcd-a220-dbff81819b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:05.873737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f202ab1-4868-4bcd-a220-dbff81819b4d None admin] PATH_INFO: `/v3/projects/2535fb8628c54af3a2a048b1e3381357` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:05.874964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f202ab1-4868-4bcd-a220-dbff81819b4d None admin] RBAC: Authorizing `identity:get_project(project_id=2535fb8628c54af3a2a048b1e3381357)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:05.876464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f202ab1-4868-4bcd-a220-dbff81819b4d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:05.878328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 47/95] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:05 2022] GET /identity/v3/projects/2535fb8628c54af3a2a048b1e3381357 => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:05.885136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202ab1-4868-4bcd-a220-dbff81819b4d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:05.960322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664c21f-41c9-48de-8e93-eb28e281847e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:06.005787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bee9fc-0a62-41e3-9f0d-79ae57375c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:06.006413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bee9fc-0a62-41e3-9f0d-79ae57375c33 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:06.006698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bee9fc-0a62-41e3-9f0d-79ae57375c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:06.006973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bee9fc-0a62-41e3-9f0d-79ae57375c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:06.007715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bee9fc-0a62-41e3-9f0d-79ae57375c33 None admin] RBAC: Adding query filter params (role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=370870b74de0407a9d8619b669b6f45f, user.id=00371932fc0e4504a658ef41b1609571) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:06.008206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bee9fc-0a62-41e3-9f0d-79ae57375c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:06.009841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bee9fc-0a62-41e3-9f0d-79ae57375c33 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:06.016396 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 49/96] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:05 2022] GET /identity/v3/role_assignments?user.id=00371932fc0e4504a658ef41b1609571&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=d2a640c46df448be87633e4dd910c74f => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:06.099076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:06.128015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f202ab1-4868-4bcd-a220-dbff81819b4d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:06.195132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6c42c-4dcc-47bf-93be-7ad133bfbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:06.196134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6c42c-4dcc-47bf-93be-7ad133bfbe92 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:06.196419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6c42c-4dcc-47bf-93be-7ad133bfbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:06.196698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6c42c-4dcc-47bf-93be-7ad133bfbe92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:06.197447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6c42c-4dcc-47bf-93be-7ad133bfbe92 None admin] RBAC: Adding query filter params (role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=2535fb8628c54af3a2a048b1e3381357, user.id=00371932fc0e4504a658ef41b1609571) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:06.197763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6c42c-4dcc-47bf-93be-7ad133bfbe92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:06.199231 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6c42c-4dcc-47bf-93be-7ad133bfbe92 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:06.209410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 48/97] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:05 2022] GET /identity/v3/role_assignments?user.id=00371932fc0e4504a658ef41b1609571&scope.project.id=2535fb8628c54af3a2a048b1e3381357&role.id=cf033ca534d941b5b3284c687e715647 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:07.123081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f356-bbbf-4f0f-bbdc-9c5095510895 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:07.123592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f356-bbbf-4f0f-bbdc-9c5095510895 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:07.123690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f356-bbbf-4f0f-bbdc-9c5095510895 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:07.125155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 50/98] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:07.135252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbe3f8-37ca-4062-b5ad-9e0a73b991e5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:07.135713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbe3f8-37ca-4062-b5ad-9e0a73b991e5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:07.135946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbe3f8-37ca-4062-b5ad-9e0a73b991e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:07.166411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-20fbe3f8-37ca-4062-b5ad-9e0a73b991e5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:07.167626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-20fbe3f8-37ca-4062-b5ad-9e0a73b991e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:07.271338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6807d7-d6a7-4b4e-8fc7-9c19ecf2909e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:07.272024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6807d7-d6a7-4b4e-8fc7-9c19ecf2909e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:07.272498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6807d7-d6a7-4b4e-8fc7-9c19ecf2909e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:07.274086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 51/99] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:07.279497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce69b1-91f7-4f53-8a0f-727c096224ee None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:07.280052 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce69b1-91f7-4f53-8a0f-727c096224ee None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:07.280416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 49/100] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:07.280755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce69b1-91f7-4f53-8a0f-727c096224ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:07.321015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-dbce69b1-91f7-4f53-8a0f-727c096224ee None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:07.322580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-dbce69b1-91f7-4f53-8a0f-727c096224ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:07.430095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 52/101] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:07.713166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527947-eb84-487b-b3b7-118b53c5581e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:07.713848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527947-eb84-487b-b3b7-118b53c5581e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:07.714333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83527947-eb84-487b-b3b7-118b53c5581e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:07.715926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 50/102] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:07.721190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6760-99a2-4bf9-8cae-4a8f81d71173 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:07.721703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6760-99a2-4bf9-8cae-4a8f81d71173 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:07.722197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6760-99a2-4bf9-8cae-4a8f81d71173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:07.752869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-bb0f6760-99a2-4bf9-8cae-4a8f81d71173 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:07.755023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bb0f6760-99a2-4bf9-8cae-4a8f81d71173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:07.765912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:07.837188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 53/103] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:07.875759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83527947-eb84-487b-b3b7-118b53c5581e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:07.979628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6760-99a2-4bf9-8cae-4a8f81d71173 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:07.984107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:08.011587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83527947-eb84-487b-b3b7-118b53c5581e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:08.048119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896971-15ed-4522-be97-1f415fd84337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:08.048767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896971-15ed-4522-be97-1f415fd84337 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.049055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896971-15ed-4522-be97-1f415fd84337 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.049334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60896971-15ed-4522-be97-1f415fd84337 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.060848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60896971-15ed-4522-be97-1f415fd84337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-60896971-15ed-4522-be97-1f415fd84337 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:08.065690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:08.067276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:08.068067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:08.070722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 51/104] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:08.074143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896971-15ed-4522-be97-1f415fd84337 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:08.183883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60896971-15ed-4522-be97-1f415fd84337 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:08.226249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:08.226874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.227160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.227438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.228986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:08.229300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:08.230769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:08.240081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:08.256056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 52/105] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:08.264880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6760-99a2-4bf9-8cae-4a8f81d71173 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:08.268111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:08.342245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0390ee-9715-488d-b44a-939efd54d4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:08.342898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0390ee-9715-488d-b44a-939efd54d4ea None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.343186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0390ee-9715-488d-b44a-939efd54d4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.343464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0390ee-9715-488d-b44a-939efd54d4ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.367387 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0390ee-9715-488d-b44a-939efd54d4ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3d0390ee-9715-488d-b44a-939efd54d4ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:08.373394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:08.374266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:08.375011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 54/106] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:08.377873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0390ee-9715-488d-b44a-939efd54d4ea None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:08.388971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:08.424170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02212ce3-8552-4238-a9c3-b1fe3f24a7e9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:08.462082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53984f2-f674-47c4-9749-33a4b8e292ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:08.462969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53984f2-f674-47c4-9749-33a4b8e292ce None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.463430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53984f2-f674-47c4-9749-33a4b8e292ce None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.463884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53984f2-f674-47c4-9749-33a4b8e292ce None admin] PATH_INFO: `/v3/users/301725fa7f074a98a5ac4e8962073092` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.478945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53984f2-f674-47c4-9749-33a4b8e292ce None admin] RBAC: Authorizing `identity:get_user(user_id=301725fa7f074a98a5ac4e8962073092)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:08.480731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53984f2-f674-47c4-9749-33a4b8e292ce None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:08.487588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 53/107] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:08 2022] GET /identity/v3/users/301725fa7f074a98a5ac4e8962073092 => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:08.488885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53984f2-f674-47c4-9749-33a4b8e292ce None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:08.552127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:08.600516 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53984f2-f674-47c4-9749-33a4b8e292ce None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:08.610899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0390ee-9715-488d-b44a-939efd54d4ea None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:08.647680 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f21e83-0322-4445-83f3-3e09c4fc12d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:08.648436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21e83-0322-4445-83f3-3e09c4fc12d2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.648792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21e83-0322-4445-83f3-3e09c4fc12d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.649003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ebed-f74f-472e-8036-1c7e4db7ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:08.649162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f21e83-0322-4445-83f3-3e09c4fc12d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.649605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ebed-f74f-472e-8036-1c7e4db7ef8b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.649898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ebed-f74f-472e-8036-1c7e4db7ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.649997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21e83-0322-4445-83f3-3e09c4fc12d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:08.650181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ebed-f74f-472e-8036-1c7e4db7ef8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.650436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21e83-0322-4445-83f3-3e09c4fc12d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:08.651426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ebed-f74f-472e-8036-1c7e4db7ef8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:08.651988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f21e83-0322-4445-83f3-3e09c4fc12d2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:08.653021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ebed-f74f-472e-8036-1c7e4db7ef8b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:08.654916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 55/108] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:08.655708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ebed-f74f-472e-8036-1c7e4db7ef8b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:08.667035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 54/109] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:08.669121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914461-4ee2-4769-92cb-6202017e2928 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.669912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914461-4ee2-4769-92cb-6202017e2928 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.670294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914461-4ee2-4769-92cb-6202017e2928 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.671933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 55/110] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:08.673043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f914461-4ee2-4769-92cb-6202017e2928 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:08.748874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:08.788162 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ebed-f74f-472e-8036-1c7e4db7ef8b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:08.811490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f914461-4ee2-4769-92cb-6202017e2928 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:08.825304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7b35f-b5f6-4cb9-88ec-c11dad147f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:08.825923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b35f-b5f6-4cb9-88ec-c11dad147f30 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.826212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b35f-b5f6-4cb9-88ec-c11dad147f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.826489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7b35f-b5f6-4cb9-88ec-c11dad147f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.831074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:08.851304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d0278-00ee-42b3-a9d6-25d543d5467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:08.851942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d0278-00ee-42b3-a9d6-25d543d5467c None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:08.852231 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d0278-00ee-42b3-a9d6-25d543d5467c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:08.852510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d0278-00ee-42b3-a9d6-25d543d5467c None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:08.853168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d0278-00ee-42b3-a9d6-25d543d5467c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:08.854619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d0278-00ee-42b3-a9d6-25d543d5467c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:08.899247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7b35f-b5f6-4cb9-88ec-c11dad147f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:08.900751 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7b35f-b5f6-4cb9-88ec-c11dad147f30 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:08.924084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 56/111] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:57:08 2022] POST /identity/v3/projects => generated 302 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:08.924979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d0278-00ee-42b3-a9d6-25d543d5467c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:09.010682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:09.058437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 56/112] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:09.063149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8b456-446c-4f56-a45c-a20bb4c659aa None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.063149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8b456-446c-4f56-a45c-a20bb4c659aa None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.063149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f8b456-446c-4f56-a45c-a20bb4c659aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.077624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d0278-00ee-42b3-a9d6-25d543d5467c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:09.084919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-80f8b456-446c-4f56-a45c-a20bb4c659aa None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:09.086318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-80f8b456-446c-4f56-a45c-a20bb4c659aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:09.125101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d7e338-ded2-47b3-9936-7faff20c1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:09.126102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7e338-ded2-47b3-9936-7faff20c1b19 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.126544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7e338-ded2-47b3-9936-7faff20c1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.126828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d7e338-ded2-47b3-9936-7faff20c1b19 None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.128010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7e338-ded2-47b3-9936-7faff20c1b19 None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:09.129582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d7e338-ded2-47b3-9936-7faff20c1b19 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:09.131789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 57/113] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:08 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:09.133132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff78c-e6b9-4da4-afac-356c66bdc9c7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.133132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff78c-e6b9-4da4-afac-356c66bdc9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.133132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ff78c-e6b9-4da4-afac-356c66bdc9c7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.135161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 58/114] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:09.135161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ff78c-e6b9-4da4-afac-356c66bdc9c7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:09.181313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 57/115] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:09.182290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8b456-446c-4f56-a45c-a20bb4c659aa None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:09.189816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:09.253447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ff78c-e6b9-4da4-afac-356c66bdc9c7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:09.289964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7d9d0-cb7c-48c7-8540-33e1bf5d29b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:09.290525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d9d0-cb7c-48c7-8540-33e1bf5d29b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.290812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d9d0-cb7c-48c7-8540-33e1bf5d29b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.291094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d9d0-cb7c-48c7-8540-33e1bf5d29b5 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.292278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7d9d0-cb7c-48c7-8540-33e1bf5d29b5 None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:09.293739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7d9d0-cb7c-48c7-8540-33e1bf5d29b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:09.298778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f8b456-446c-4f56-a45c-a20bb4c659aa None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:09.300316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:09.300489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 59/116] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:09 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:09.302931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb9f85-8b25-4e1e-b82e-c817a76483d1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.303223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb9f85-8b25-4e1e-b82e-c817a76483d1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.303559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb9f85-8b25-4e1e-b82e-c817a76483d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.323462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cdbb9f85-8b25-4e1e-b82e-c817a76483d1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:09.324727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cdbb9f85-8b25-4e1e-b82e-c817a76483d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:09.337855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975476e-c2e1-45d4-a742-331585f16051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:09.338511 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975476e-c2e1-45d4-a742-331585f16051 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.338801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975476e-c2e1-45d4-a742-331585f16051 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.339080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975476e-c2e1-45d4-a742-331585f16051 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.340385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975476e-c2e1-45d4-a742-331585f16051 None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:09.341927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975476e-c2e1-45d4-a742-331585f16051 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:09.343675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 58/117] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:09 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:09.344933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679a3c-3f0c-4a4b-9eb7-480cf07163df None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.345224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679a3c-3f0c-4a4b-9eb7-480cf07163df None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.345504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29679a3c-3f0c-4a4b-9eb7-480cf07163df None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.346711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 59/118] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:09.347415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29679a3c-3f0c-4a4b-9eb7-480cf07163df None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:09.402179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 60/119] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:09.403491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b4f8b-a472-4405-aaa9-e08ccdda59dc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.403973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b4f8b-a472-4405-aaa9-e08ccdda59dc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.404310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b4f8b-a472-4405-aaa9-e08ccdda59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.436747 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4a8b4f8b-a472-4405-aaa9-e08ccdda59dc None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:09.437947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4a8b4f8b-a472-4405-aaa9-e08ccdda59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:09.477197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:09.518391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 61/120] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:09.522926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b4f8b-a472-4405-aaa9-e08ccdda59dc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:09.570639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29679a3c-3f0c-4a4b-9eb7-480cf07163df None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:09.626216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:09.626833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.627119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.627394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.628208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] RBAC: Adding query filter params (role.id=61ad56bfd6a646e19984b23e39b8b664, scope.project.id=370870b74de0407a9d8619b669b6f45f, user.id=301725fa7f074a98a5ac4e8962073092) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:09.628517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:09.630761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:09.642344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 60/121] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:09 2022] GET /identity/v3/role_assignments?user.id=301725fa7f074a98a5ac4e8962073092&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=61ad56bfd6a646e19984b23e39b8b664 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:09.644254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:09.707652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b4f8b-a472-4405-aaa9-e08ccdda59dc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:09.718142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:09.780153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c50a6e-c309-4f9f-bc79-3dbb43498f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:09.780846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c50a6e-c309-4f9f-bc79-3dbb43498f77 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.781130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c50a6e-c309-4f9f-bc79-3dbb43498f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.781411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c50a6e-c309-4f9f-bc79-3dbb43498f77 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f/users/00371932fc0e4504a658ef41b1609571/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.789809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c50a6e-c309-4f9f-bc79-3dbb43498f77 None admin] RBAC: Authorizing `identity:create_grant(project_id=370870b74de0407a9d8619b669b6f45f, user_id=00371932fc0e4504a658ef41b1609571, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:09.791299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c50a6e-c309-4f9f-bc79-3dbb43498f77 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:09.826686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade042b2-b125-43a2-802b-051e57ce9346 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:09.855144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 62/122] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:09 2022] PUT /identity/v3/projects/370870b74de0407a9d8619b669b6f45f/users/00371932fc0e4504a658ef41b1609571/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:09.856099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c50a6e-c309-4f9f-bc79-3dbb43498f77 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:09.884857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2988ef-620e-4047-90cf-dbfb1f0c6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:09.886002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2988ef-620e-4047-90cf-dbfb1f0c6485 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:09.886002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2988ef-620e-4047-90cf-dbfb1f0c6485 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:09.886162 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2988ef-620e-4047-90cf-dbfb1f0c6485 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:09.911182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:09.912062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2988ef-620e-4047-90cf-dbfb1f0c6485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-2f2988ef-620e-4047-90cf-dbfb1f0c6485 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:09.917680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:09.918604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:09.919345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:09.924057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 61/123] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:09.925035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2988ef-620e-4047-90cf-dbfb1f0c6485 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.060665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c50a6e-c309-4f9f-bc79-3dbb43498f77 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.112133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f95efb-e802-4ce7-a29a-f696de59b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.112704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95efb-e802-4ce7-a29a-f696de59b582 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.112991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95efb-e802-4ce7-a29a-f696de59b582 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.113826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95efb-e802-4ce7-a29a-f696de59b582 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.114862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:10.123534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2988ef-620e-4047-90cf-dbfb1f0c6485 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.128735 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f95efb-e802-4ce7-a29a-f696de59b582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-27f95efb-e802-4ce7-a29a-f696de59b582 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:10.135879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:10.136813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:10.137660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 63/124] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:10.138276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f95efb-e802-4ce7-a29a-f696de59b582 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.174985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b084c-2afc-4138-bf24-a6fe28654774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.176217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b084c-2afc-4138-bf24-a6fe28654774 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.176516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b084c-2afc-4138-bf24-a6fe28654774 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.176798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b084c-2afc-4138-bf24-a6fe28654774 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.188542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b084c-2afc-4138-bf24-a6fe28654774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-c13b084c-2afc-4138-bf24-a6fe28654774 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:10.194121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:10.194980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:10.196075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 62/125] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:10.196785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b084c-2afc-4138-bf24-a6fe28654774 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.249868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:10.267462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f95efb-e802-4ce7-a29a-f696de59b582 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.306900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.308314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.308963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.309666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.311127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:10.311827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:10.314021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:10.323960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 64/126] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:10.325046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.330113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b084c-2afc-4138-bf24-a6fe28654774 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.402709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.403259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.403547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.403849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.404529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:10.404838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:10.406228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:10.427580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 63/127] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:10.428624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.439389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3961e0a-d7bd-4d25-8c92-e37eab3a06e8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.469419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:10.480330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.481285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.481762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.482251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.483165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:10.483664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:10.485423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:10.495333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 65/128] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:10.496437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.516110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:10.582584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a52f-27a2-4859-a6b1-549ecb5cf2af None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.612141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54358aa0-97ce-4491-8aea-2bd941cf42a3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.620255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee541126-f640-4bcf-90a0-c7f5d2deb5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.620890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541126-f640-4bcf-90a0-c7f5d2deb5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.621180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541126-f640-4bcf-90a0-c7f5d2deb5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.621498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541126-f640-4bcf-90a0-c7f5d2deb5b0 None admin] PATH_INFO: `/v3/users/094bda4debcf4532ab8f582465d0a41a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.622798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee541126-f640-4bcf-90a0-c7f5d2deb5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=094bda4debcf4532ab8f582465d0a41a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:10.624417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee541126-f640-4bcf-90a0-c7f5d2deb5b0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:10.626259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 64/129] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/users/094bda4debcf4532ab8f582465d0a41a => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:10.626928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee541126-f640-4bcf-90a0-c7f5d2deb5b0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.663166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a139df8-2582-48bd-8622-de3e71448997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.664148 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a139df8-2582-48bd-8622-de3e71448997 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.664678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a139df8-2582-48bd-8622-de3e71448997 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.665251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a139df8-2582-48bd-8622-de3e71448997 None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.667402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a139df8-2582-48bd-8622-de3e71448997 None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:10.669291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a139df8-2582-48bd-8622-de3e71448997 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:10.671233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 66/130] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:10.672273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a139df8-2582-48bd-8622-de3e71448997 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.773774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:10.791157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:10.802511 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee541126-f640-4bcf-90a0-c7f5d2deb5b0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.818749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a139df8-2582-48bd-8622-de3e71448997 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:10.872120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68831f-c0c9-4a4c-8593-fd4321ac5d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.872760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68831f-c0c9-4a4c-8593-fd4321ac5d83 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.873040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68831f-c0c9-4a4c-8593-fd4321ac5d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.873315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68831f-c0c9-4a4c-8593-fd4321ac5d83 None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.875441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68831f-c0c9-4a4c-8593-fd4321ac5d83 None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:10.877004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68831f-c0c9-4a4c-8593-fd4321ac5d83 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:10.880140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 65/131] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:10.880998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68831f-c0c9-4a4c-8593-fd4321ac5d83 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:10.893405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3e35-aa0b-42e5-a72c-07530c5def2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:10.894056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3e35-aa0b-42e5-a72c-07530c5def2f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:10.894361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3e35-aa0b-42e5-a72c-07530c5def2f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:10.894649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3e35-aa0b-42e5-a72c-07530c5def2f None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:10.896472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d3e35-aa0b-42e5-a72c-07530c5def2f None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:10.897957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d3e35-aa0b-42e5-a72c-07530c5def2f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:10.899847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 67/132] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:10.900396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3e35-aa0b-42e5-a72c-07530c5def2f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:11.086872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3e35-aa0b-42e5-a72c-07530c5def2f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:11.093641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68831f-c0c9-4a4c-8593-fd4321ac5d83 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:11.159222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7773996-857d-4b3b-997a-07851b6398ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:11.159932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7773996-857d-4b3b-997a-07851b6398ea None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:11.160452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7773996-857d-4b3b-997a-07851b6398ea None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:11.160945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7773996-857d-4b3b-997a-07851b6398ea None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:11.162210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7773996-857d-4b3b-997a-07851b6398ea None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:11.163911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7773996-857d-4b3b-997a-07851b6398ea None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:11.165760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 68/133] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:11.166494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7773996-857d-4b3b-997a-07851b6398ea None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:11.167603 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d64fc-0c09-404c-9163-5a99e6d92aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:11.168281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d64fc-0c09-404c-9163-5a99e6d92aeb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:11.168567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d64fc-0c09-404c-9163-5a99e6d92aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:11.168846 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d64fc-0c09-404c-9163-5a99e6d92aeb None admin] PATH_INFO: `/v3/projects/2535fb8628c54af3a2a048b1e3381357` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:11.174838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d64fc-0c09-404c-9163-5a99e6d92aeb None admin] RBAC: Authorizing `identity:get_project(project_id=2535fb8628c54af3a2a048b1e3381357)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:11.178401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d64fc-0c09-404c-9163-5a99e6d92aeb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:11.180452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 66/134] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:10 2022] GET /identity/v3/projects/2535fb8628c54af3a2a048b1e3381357 => generated 312 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:11.181228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d64fc-0c09-404c-9163-5a99e6d92aeb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:11.211756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:11.229577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:11.343841 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7773996-857d-4b3b-997a-07851b6398ea None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:11.361568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d64fc-0c09-404c-9163-5a99e6d92aeb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:11.381438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16e57a-ac5f-47ae-9833-3c1003d46408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:11.382105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e57a-ac5f-47ae-9833-3c1003d46408 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:11.382386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e57a-ac5f-47ae-9833-3c1003d46408 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:11.382671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16e57a-ac5f-47ae-9833-3c1003d46408 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f/users/094bda4debcf4532ab8f582465d0a41a/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:11.384851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16e57a-ac5f-47ae-9833-3c1003d46408 None admin] RBAC: Authorizing `identity:create_grant(project_id=370870b74de0407a9d8619b669b6f45f, user_id=094bda4debcf4532ab8f582465d0a41a, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:11.386282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16e57a-ac5f-47ae-9833-3c1003d46408 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:11.403300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27964ec-231c-449b-903e-ba51468c636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:11.404101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27964ec-231c-449b-903e-ba51468c636a None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:11.404508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27964ec-231c-449b-903e-ba51468c636a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:11.404839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27964ec-231c-449b-903e-ba51468c636a None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f/users/00371932fc0e4504a658ef41b1609571/roles/d2a640c46df448be87633e4dd910c74f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:11.407050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27964ec-231c-449b-903e-ba51468c636a None admin] RBAC: Authorizing `identity:create_grant(project_id=370870b74de0407a9d8619b669b6f45f, user_id=00371932fc0e4504a658ef41b1609571, role_id=d2a640c46df448be87633e4dd910c74f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:11.408540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27964ec-231c-449b-903e-ba51468c636a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:11.494370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 69/135] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:11 2022] PUT /identity/v3/projects/370870b74de0407a9d8619b669b6f45f/users/094bda4debcf4532ab8f582465d0a41a/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:11.495180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16e57a-ac5f-47ae-9833-3c1003d46408 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:11.522815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 67/136] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:11 2022] PUT /identity/v3/projects/370870b74de0407a9d8619b669b6f45f/users/00371932fc0e4504a658ef41b1609571/roles/d2a640c46df448be87633e4dd910c74f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:11.524360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8ec56-0d4a-4c10-b59d-e36c46e8dca4 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:11.524655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8ec56-0d4a-4c10-b59d-e36c46e8dca4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:11.525142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8ec56-0d4a-4c10-b59d-e36c46e8dca4 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:11.526513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 68/137] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:11.545395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d514-d598-4822-a7dd-6bc716912e82 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:11.545698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d514-d598-4822-a7dd-6bc716912e82 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:11.546381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68d514-d598-4822-a7dd-6bc716912e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:11.580967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9e68d514-d598-4822-a7dd-6bc716912e82 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:11.583020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9e68d514-d598-4822-a7dd-6bc716912e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:11.605367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:11.637156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16e57a-ac5f-47ae-9833-3c1003d46408 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:11.678788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de128d54-a009-41a3-bb1b-19f8c6e104c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:11.679806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128d54-a009-41a3-bb1b-19f8c6e104c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:11.680338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128d54-a009-41a3-bb1b-19f8c6e104c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:11.680822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128d54-a009-41a3-bb1b-19f8c6e104c3 None admin] PATH_INFO: `/v3/projects/2535fb8628c54af3a2a048b1e3381357/users/00371932fc0e4504a658ef41b1609571/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:11.683336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de128d54-a009-41a3-bb1b-19f8c6e104c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2535fb8628c54af3a2a048b1e3381357, user_id=00371932fc0e4504a658ef41b1609571, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:11.685312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de128d54-a009-41a3-bb1b-19f8c6e104c3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:11.710780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 69/138] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:11.764639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 70/139] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:11 2022] PUT /identity/v3/projects/2535fb8628c54af3a2a048b1e3381357/users/00371932fc0e4504a658ef41b1609571/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:12.165472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee9cc4-76e7-4250-a752-b9f3b767cd86 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:12.165842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee9cc4-76e7-4250-a752-b9f3b767cd86 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:12.166124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee9cc4-76e7-4250-a752-b9f3b767cd86 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:12.167476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 70/140] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:12.182906 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839a70-a958-4b02-938f-17b79ca5a538 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:12.183215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839a70-a958-4b02-938f-17b79ca5a538 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:12.183483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839a70-a958-4b02-938f-17b79ca5a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:12.208777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-54839a70-a958-4b02-938f-17b79ca5a538 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:12.210010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-54839a70-a958-4b02-938f-17b79ca5a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:12.265117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee9cc4-76e7-4250-a752-b9f3b767cd86 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:12.284339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:12.335141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 71/141] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:12.341170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dd49-6b36-469f-b1c4-93bf97e23143 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:12.341372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dd49-6b36-469f-b1c4-93bf97e23143 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:12.341658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dd49-6b36-469f-b1c4-93bf97e23143 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:12.343042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 72/142] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:12.357358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1664-455e-47af-a000-5ab4418fa1f7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:12.357965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1664-455e-47af-a000-5ab4418fa1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:12.357965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e1664-455e-47af-a000-5ab4418fa1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:12.395635 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1b1e1664-455e-47af-a000-5ab4418fa1f7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:12.397576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1b1e1664-455e-47af-a000-5ab4418fa1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:12.399175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee9cc4-76e7-4250-a752-b9f3b767cd86 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:12.438468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e698f5-b87e-4e3c-b98b-71855361c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:12.439423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e698f5-b87e-4e3c-b98b-71855361c015 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:12.440040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e698f5-b87e-4e3c-b98b-71855361c015 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:12.440516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e698f5-b87e-4e3c-b98b-71855361c015 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:12.447917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e698f5-b87e-4e3c-b98b-71855361c015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:12.447917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e698f5-b87e-4e3c-b98b-71855361c015 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:12.449362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 71/143] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:12.458012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e698f5-b87e-4e3c-b98b-71855361c015 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:12.552193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:12.574615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 73/144] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:12.621230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:12.649104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e698f5-b87e-4e3c-b98b-71855361c015 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:12.697481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fac91-78b1-44de-a7fc-fc32de0e967f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:12.698028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fac91-78b1-44de-a7fc-fc32de0e967f None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:12.698317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fac91-78b1-44de-a7fc-fc32de0e967f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:12.698600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fac91-78b1-44de-a7fc-fc32de0e967f None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:12.699264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fac91-78b1-44de-a7fc-fc32de0e967f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:12.700796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90fac91-78b1-44de-a7fc-fc32de0e967f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:12.814998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 72/145] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:12 2022] POST /identity/v3/users => generated 283 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:12.821709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e1664-455e-47af-a000-5ab4418fa1f7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:12.967480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e1664-455e-47af-a000-5ab4418fa1f7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:13.033064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079de704-aa54-4d43-83f3-099cb5a5bba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:13.033722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de704-aa54-4d43-83f3-099cb5a5bba3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:13.034007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de704-aa54-4d43-83f3-099cb5a5bba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:13.034279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079de704-aa54-4d43-83f3-099cb5a5bba3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:13.052524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079de704-aa54-4d43-83f3-099cb5a5bba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:13.052822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fac91-78b1-44de-a7fc-fc32de0e967f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-079de704-aa54-4d43-83f3-099cb5a5bba3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:13.057690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:13.058597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:13.059365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 74/146] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:13.072692 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079de704-aa54-4d43-83f3-099cb5a5bba3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:13.141068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:13.191818 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079de704-aa54-4d43-83f3-099cb5a5bba3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:13.255535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:13.256537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:13.257031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:13.257495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:13.258366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:13.258950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:13.262064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fac91-78b1-44de-a7fc-fc32de0e967f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:13.263233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:13.287790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 75/147] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:13.297025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:13.390997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b43a2-1a3b-4ac2-b875-f3b59774c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:13.391659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b43a2-1a3b-4ac2-b875-f3b59774c092 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:13.391978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b43a2-1a3b-4ac2-b875-f3b59774c092 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:13.392284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b43a2-1a3b-4ac2-b875-f3b59774c092 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:13.403690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:13.426629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b43a2-1a3b-4ac2-b875-f3b59774c092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ce7b43a2-1a3b-4ac2-b875-f3b59774c092 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:13.443817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:13.444730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:13.445737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 73/148] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:13.457791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b43a2-1a3b-4ac2-b875-f3b59774c092 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:13.475755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3068d-a98b-45e6-946e-ce9eca9efa78 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:13.525806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:13.621443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4beec-8ed4-4419-bb0b-9f85817a11e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:13.621443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4beec-8ed4-4419-bb0b-9f85817a11e6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:13.621443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4beec-8ed4-4419-bb0b-9f85817a11e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:13.621443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4beec-8ed4-4419-bb0b-9f85817a11e6 None admin] PATH_INFO: `/v3/users/301725fa7f074a98a5ac4e8962073092` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:13.627746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4beec-8ed4-4419-bb0b-9f85817a11e6 None admin] RBAC: Authorizing `identity:get_user(user_id=301725fa7f074a98a5ac4e8962073092)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:13.630932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f4beec-8ed4-4419-bb0b-9f85817a11e6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:13.630932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 76/149] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:13 2022] GET /identity/v3/users/301725fa7f074a98a5ac4e8962073092 => generated 289 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:13.643765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4beec-8ed4-4419-bb0b-9f85817a11e6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:13.799837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b43a2-1a3b-4ac2-b875-f3b59774c092 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:13.854871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4beec-8ed4-4419-bb0b-9f85817a11e6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:13.861374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:13.862003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:13.862285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:13.862671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:13.863974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:13.864285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:13.865801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:13.875999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 74/150] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:13.881426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:13.899860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a179bf-9360-4931-a0f8-0482204a4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:13.900509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a179bf-9360-4931-a0f8-0482204a4510 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:13.900839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a179bf-9360-4931-a0f8-0482204a4510 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:13.901123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a179bf-9360-4931-a0f8-0482204a4510 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:13.902643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a179bf-9360-4931-a0f8-0482204a4510 None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:13.905225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a179bf-9360-4931-a0f8-0482204a4510 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:13.907362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 77/151] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:13 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:13.913800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a179bf-9360-4931-a0f8-0482204a4510 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:13.974097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:13.980075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:14.052018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c01b1d-14ad-4fd2-af18-27cb9885dcd6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:14.052185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a179bf-9360-4931-a0f8-0482204a4510 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:14.106930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4282a68-5314-4716-a5b0-d1497108f872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:14.107659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282a68-5314-4716-a5b0-d1497108f872 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:14.107967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282a68-5314-4716-a5b0-d1497108f872 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:14.108241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4282a68-5314-4716-a5b0-d1497108f872 None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:14.109838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4282a68-5314-4716-a5b0-d1497108f872 None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:14.111270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4282a68-5314-4716-a5b0-d1497108f872 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:14.113679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64270725-94b3-4887-9d92-a3d49a851b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:14.114599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270725-94b3-4887-9d92-a3d49a851b49 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:14.114887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270725-94b3-4887-9d92-a3d49a851b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:14.115161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270725-94b3-4887-9d92-a3d49a851b49 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f/users/301725fa7f074a98a5ac4e8962073092/roles/61ad56bfd6a646e19984b23e39b8b664` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:14.124961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 75/152] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:13 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:14.125915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4282a68-5314-4716-a5b0-d1497108f872 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:14.127023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270725-94b3-4887-9d92-a3d49a851b49 None admin] RBAC: Authorizing `identity:create_grant(project_id=370870b74de0407a9d8619b669b6f45f, user_id=301725fa7f074a98a5ac4e8962073092, role_id=61ad56bfd6a646e19984b23e39b8b664)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:14.128618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270725-94b3-4887-9d92-a3d49a851b49 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:14.226116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 78/153] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:13 2022] PUT /identity/v3/projects/370870b74de0407a9d8619b669b6f45f/users/301725fa7f074a98a5ac4e8962073092/roles/61ad56bfd6a646e19984b23e39b8b664 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:14.265193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b6465-e139-4355-bccf-e51997dd29e3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:14.265513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b6465-e139-4355-bccf-e51997dd29e3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:14.265729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b6465-e139-4355-bccf-e51997dd29e3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:14.267322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 79/154] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:14.279207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194389a6-20c1-438e-8309-ac13bb1c187c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:14.279545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194389a6-20c1-438e-8309-ac13bb1c187c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:14.279778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194389a6-20c1-438e-8309-ac13bb1c187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:14.298718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4282a68-5314-4716-a5b0-d1497108f872 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:14.316687 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-194389a6-20c1-438e-8309-ac13bb1c187c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:14.318678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-194389a6-20c1-438e-8309-ac13bb1c187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:14.356146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:14.377566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581153c-ce04-4631-8a21-053eb0174ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:14.378265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581153c-ce04-4631-8a21-053eb0174ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:14.378623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581153c-ce04-4631-8a21-053eb0174ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:14.378917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581153c-ce04-4631-8a21-053eb0174ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:14.466573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 80/155] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:14.511850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581153c-ce04-4631-8a21-053eb0174ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:14.513393 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581153c-ce04-4631-8a21-053eb0174ed4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:14.567843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c115fa-91eb-4d37-9450-99e4f35a9a75 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:14.568315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c115fa-91eb-4d37-9450-99e4f35a9a75 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:14.568315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c115fa-91eb-4d37-9450-99e4f35a9a75 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:14.569909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 81/156] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:14.577550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa285d6a-07c1-48ae-96b6-ee223f80c8b6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:14.577830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa285d6a-07c1-48ae-96b6-ee223f80c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:14.578101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa285d6a-07c1-48ae-96b6-ee223f80c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:14.605726 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fa285d6a-07c1-48ae-96b6-ee223f80c8b6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:14.607008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fa285d6a-07c1-48ae-96b6-ee223f80c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:14.635186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 76/157] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:14.641188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581153c-ce04-4631-8a21-053eb0174ed4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:14.700106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:14.701688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:14.783104 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 82/158] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:14.825414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581153c-ce04-4631-8a21-053eb0174ed4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:14.867304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a0ee-2d2a-4d8e-9f18-77220391ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:14.868023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a0ee-2d2a-4d8e-9f18-77220391ce1a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:14.868317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a0ee-2d2a-4d8e-9f18-77220391ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:14.868595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a0ee-2d2a-4d8e-9f18-77220391ce1a None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:14.869817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5a0ee-2d2a-4d8e-9f18-77220391ce1a None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:14.871278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5a0ee-2d2a-4d8e-9f18-77220391ce1a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:14.872944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 77/159] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:14 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:14.879012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa285d6a-07c1-48ae-96b6-ee223f80c8b6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:15.001764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ce075-873a-48de-8287-27acba4d32d5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:15.002102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ce075-873a-48de-8287-27acba4d32d5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:15.002327 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ce075-873a-48de-8287-27acba4d32d5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:15.004359 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 78/160] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:15.015478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa285d6a-07c1-48ae-96b6-ee223f80c8b6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:15.017775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd980a-c1e3-45eb-b331-db4aea4004a6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:15.018064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd980a-c1e3-45eb-b331-db4aea4004a6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:15.018344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd980a-c1e3-45eb-b331-db4aea4004a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:15.045539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-72cd980a-c1e3-45eb-b331-db4aea4004a6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:15.046754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-72cd980a-c1e3-45eb-b331-db4aea4004a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:15.116173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:15.116711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:15.116994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:15.117268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:15.118004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] RBAC: Adding query filter params (role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=370870b74de0407a9d8619b669b6f45f, user.id=00371932fc0e4504a658ef41b1609571) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:15.118315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:15.119765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:15.145468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 83/161] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:14 2022] GET /identity/v3/role_assignments?user.id=00371932fc0e4504a658ef41b1609571&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=cf033ca534d941b5b3284c687e715647 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:15.145468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:15.217014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 79/162] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 18:57:15.254018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:15.321948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee097a-f4b9-4c43-af25-09d700f9c04e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:15.371118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5eca-e4dd-4126-bfa0-6a531b3cfdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:15.372109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5eca-e4dd-4126-bfa0-6a531b3cfdfa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:15.372586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5eca-e4dd-4126-bfa0-6a531b3cfdfa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:15.373051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5eca-e4dd-4126-bfa0-6a531b3cfdfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:15.389907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d5eca-e4dd-4126-bfa0-6a531b3cfdfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4c7d5eca-e4dd-4126-bfa0-6a531b3cfdfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:15.395679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:15.396615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:15.397386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:15.403637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 84/163] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:15.406295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd980a-c1e3-45eb-b331-db4aea4004a6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:15.454479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:15.466304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5eca-e4dd-4126-bfa0-6a531b3cfdfa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:15.594634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd980a-c1e3-45eb-b331-db4aea4004a6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:15.638461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:15.648226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5eca-e4dd-4126-bfa0-6a531b3cfdfa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:15.669954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:15.670706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:15.670881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:15.671158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:15.672090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:15.672193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:15.673523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:15.686422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 80/164] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:15.693004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:15.710607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1a367-637b-4638-8939-442c0a974b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:15.711256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a367-637b-4638-8939-442c0a974b95 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:15.711540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a367-637b-4638-8939-442c0a974b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:15.711842 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a367-637b-4638-8939-442c0a974b95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:15.743277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1a367-637b-4638-8939-442c0a974b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-bec1a367-637b-4638-8939-442c0a974b95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:15.748303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:15.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:15.749947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 85/165] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:15.758318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1a367-637b-4638-8939-442c0a974b95 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:15.819644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:15.840120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21436fea-e623-4184-8c42-566dd9ec7e2a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:15.896593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb58089-1326-4748-b729-382880e2af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:15.897163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58089-1326-4748-b729-382880e2af5a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:15.897448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58089-1326-4748-b729-382880e2af5a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:15.897724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58089-1326-4748-b729-382880e2af5a None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:15.898961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb58089-1326-4748-b729-382880e2af5a None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:15.900448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb58089-1326-4748-b729-382880e2af5a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:15.902189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 81/166] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:15 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:15.916990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1a367-637b-4638-8939-442c0a974b95 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:15.927032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb58089-1326-4748-b729-382880e2af5a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:15.969310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:15.969975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:15.970340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:15.970513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:15.971187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:15.971490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:15.973508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:15.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 86/167] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:15.992984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:16.032716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:16.095656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb58089-1326-4748-b729-382880e2af5a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:16.116490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c0b15-a52f-4d87-8f9e-383d473f8be6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:16.147817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f807eb-f231-40cc-afaa-ba0f07534f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:16.148388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f807eb-f231-40cc-afaa-ba0f07534f61 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:16.148679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f807eb-f231-40cc-afaa-ba0f07534f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:16.148957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f807eb-f231-40cc-afaa-ba0f07534f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:16.168441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8083a19-ae16-4b23-8947-94c0afee9d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:16.169155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083a19-ae16-4b23-8947-94c0afee9d12 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:16.169435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083a19-ae16-4b23-8947-94c0afee9d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:16.169707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8083a19-ae16-4b23-8947-94c0afee9d12 None admin] PATH_INFO: `/v3/users/094bda4debcf4532ab8f582465d0a41a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:16.172963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8083a19-ae16-4b23-8947-94c0afee9d12 None admin] RBAC: Authorizing `identity:get_user(user_id=094bda4debcf4532ab8f582465d0a41a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:16.174447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8083a19-ae16-4b23-8947-94c0afee9d12 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:16.182562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 87/168] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:15 2022] GET /identity/v3/users/094bda4debcf4532ab8f582465d0a41a => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:16.184023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8083a19-ae16-4b23-8947-94c0afee9d12 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:16.211700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:16.338059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f807eb-f231-40cc-afaa-ba0f07534f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:16.340050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f807eb-f231-40cc-afaa-ba0f07534f61 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:16.413745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:16.478338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8083a19-ae16-4b23-8947-94c0afee9d12 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:16.528728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 82/169] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:57:16.529974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f807eb-f231-40cc-afaa-ba0f07534f61 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:16.576886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f1be-aa7c-4dc0-914f-885b5df40af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:16.577537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f1be-aa7c-4dc0-914f-885b5df40af0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:16.577823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f1be-aa7c-4dc0-914f-885b5df40af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:16.578097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f1be-aa7c-4dc0-914f-885b5df40af0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:16.604662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082f1be-aa7c-4dc0-914f-885b5df40af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e082f1be-aa7c-4dc0-914f-885b5df40af0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:16.610050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:16.610989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:16.611852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 88/170] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:16.612555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f1be-aa7c-4dc0-914f-885b5df40af0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:16.641759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:16.759641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f807eb-f231-40cc-afaa-ba0f07534f61 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:16.817409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f1be-aa7c-4dc0-914f-885b5df40af0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:16.844497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324592f-36bf-4c97-9218-a3e64a382182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:16.845217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324592f-36bf-4c97-9218-a3e64a382182 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:16.845501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324592f-36bf-4c97-9218-a3e64a382182 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:16.845780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324592f-36bf-4c97-9218-a3e64a382182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:16.880495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5a97-6861-42fd-8779-6e7be78d6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:16.881147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5a97-6861-42fd-8779-6e7be78d6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:16.881429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5a97-6861-42fd-8779-6e7be78d6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:16.881704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae5a97-6861-42fd-8779-6e7be78d6ca0 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:16.883127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae5a97-6861-42fd-8779-6e7be78d6ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:16.884720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae5a97-6861-42fd-8779-6e7be78d6ca0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:16.886348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 89/171] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:16 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:16.887180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5a97-6861-42fd-8779-6e7be78d6ca0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:16.916106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:16.968766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324592f-36bf-4c97-9218-a3e64a382182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:16.970607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324592f-36bf-4c97-9218-a3e64a382182 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:17.037775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae5a97-6861-42fd-8779-6e7be78d6ca0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:17.100692 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:17.101439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.101723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.102045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.102719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:17.103045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:17.104422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:17.111102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:17.119424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 90/172] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:17.126608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:17.259973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 83/173] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:17.260846 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324592f-36bf-4c97-9218-a3e64a382182 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:17.288679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:17.332239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac670c68-f590-4217-801e-7d2843369559 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:17.414269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2affae-08a3-4e48-99ac-85b1482f934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:17.418268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2affae-08a3-4e48-99ac-85b1482f934a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.418268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2affae-08a3-4e48-99ac-85b1482f934a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.418268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2affae-08a3-4e48-99ac-85b1482f934a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.418268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2affae-08a3-4e48-99ac-85b1482f934a None admin] RBAC: Adding query filter params (role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=370870b74de0407a9d8619b669b6f45f, user.id=00371932fc0e4504a658ef41b1609571) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:17.418268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2affae-08a3-4e48-99ac-85b1482f934a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:17.422254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2affae-08a3-4e48-99ac-85b1482f934a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:17.434339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 91/174] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:17 2022] GET /identity/v3/role_assignments?user.id=00371932fc0e4504a658ef41b1609571&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=d2a640c46df448be87633e4dd910c74f => generated 608 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:17.435570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211930bc-4eec-46d7-994f-65813a3f7d6d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.435757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324592f-36bf-4c97-9218-a3e64a382182 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:17.436081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211930bc-4eec-46d7-994f-65813a3f7d6d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.436364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211930bc-4eec-46d7-994f-65813a3f7d6d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.443757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 92/175] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:17.443757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211930bc-4eec-46d7-994f-65813a3f7d6d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:17.486931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671b101-59f1-48f5-9e19-8df1042e5d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:17.487597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b101-59f1-48f5-9e19-8df1042e5d39 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.487941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b101-59f1-48f5-9e19-8df1042e5d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.488343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b101-59f1-48f5-9e19-8df1042e5d39 None admin] PATH_INFO: `/v3/users/00371932fc0e4504a658ef41b1609571` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.490045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671b101-59f1-48f5-9e19-8df1042e5d39 None admin] RBAC: Authorizing `identity:get_user(user_id=00371932fc0e4504a658ef41b1609571)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:17.491546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671b101-59f1-48f5-9e19-8df1042e5d39 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:17.493872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 84/176] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:17 2022] GET /identity/v3/users/00371932fc0e4504a658ef41b1609571 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:17.495070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca4d6-6d7d-4625-87d5-d7b14d205edf None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.495440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca4d6-6d7d-4625-87d5-d7b14d205edf None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.495830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca4d6-6d7d-4625-87d5-d7b14d205edf None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.497189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 85/177] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:17.498203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689c1d-6841-4789-9361-d7f7717c1411 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.498488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689c1d-6841-4789-9361-d7f7717c1411 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.498764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9689c1d-6841-4789-9361-d7f7717c1411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.519847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a9689c1d-6841-4789-9361-d7f7717c1411 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:17.521219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a9689c1d-6841-4789-9361-d7f7717c1411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:17.542776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:17.606972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 86/178] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:17.608306 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e0af1-c9a0-40ec-b5d3-191a24d96122 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.608597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e0af1-c9a0-40ec-b5d3-191a24d96122 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.608877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e0af1-c9a0-40ec-b5d3-191a24d96122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.652151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-293e0af1-c9a0-40ec-b5d3-191a24d96122 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:17.653354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-293e0af1-c9a0-40ec-b5d3-191a24d96122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:17.662073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211930bc-4eec-46d7-994f-65813a3f7d6d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:17.716811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6a097-4daf-40fa-bd09-cb91aa393fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:17.717441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6a097-4daf-40fa-bd09-cb91aa393fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.717720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6a097-4daf-40fa-bd09-cb91aa393fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.717989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6a097-4daf-40fa-bd09-cb91aa393fd6 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.719195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6a097-4daf-40fa-bd09-cb91aa393fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:17.720870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6a097-4daf-40fa-bd09-cb91aa393fd6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:17.725309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 93/179] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:17 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:17.726454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6a097-4daf-40fa-bd09-cb91aa393fd6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:17.739415 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:17.770875 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 87/180] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:17.772726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0444d-0044-48a4-8f22-c65d59eb49df None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.772726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0444d-0044-48a4-8f22-c65d59eb49df None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.772919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0444d-0044-48a4-8f22-c65d59eb49df None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.774086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 88/181] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:17.774832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0444d-0044-48a4-8f22-c65d59eb49df None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:17.854326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6a097-4daf-40fa-bd09-cb91aa393fd6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:17.865930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:17.892079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0444d-0044-48a4-8f22-c65d59eb49df None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:17.897696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f4623-8620-46b2-bd10-348ab902007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:17.898619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4623-8620-46b2-bd10-348ab902007d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.899101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4623-8620-46b2-bd10-348ab902007d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.899545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4623-8620-46b2-bd10-348ab902007d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.934619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57632a-03dc-445a-8c19-b6a7b5b62e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:17.935245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57632a-03dc-445a-8c19-b6a7b5b62e06 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.935499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57632a-03dc-445a-8c19-b6a7b5b62e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.935799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57632a-03dc-445a-8c19-b6a7b5b62e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.936536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57632a-03dc-445a-8c19-b6a7b5b62e06 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=370870b74de0407a9d8619b669b6f45f, user.id=094bda4debcf4532ab8f582465d0a41a) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:17.936844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57632a-03dc-445a-8c19-b6a7b5b62e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:17.938307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57632a-03dc-445a-8c19-b6a7b5b62e06 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:17.944987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 89/182] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:17 2022] GET /identity/v3/role_assignments?user.id=094bda4debcf4532ab8f582465d0a41a&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:17.946677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e89e-0226-402a-bfed-315db5abb33a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.946969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e89e-0226-402a-bfed-315db5abb33a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.947250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e89e-0226-402a-bfed-315db5abb33a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.949047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 90/183] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:17.949708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d60c-b7bb-4044-964a-395c533b90c7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:17.949991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d60c-b7bb-4044-964a-395c533b90c7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:17.950265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0801d60c-b7bb-4044-964a-395c533b90c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:17.975516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0801d60c-b7bb-4044-964a-395c533b90c7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:17.976791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0801d60c-b7bb-4044-964a-395c533b90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:17.992845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f4623-8620-46b2-bd10-348ab902007d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:17.994516 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f4623-8620-46b2-bd10-348ab902007d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:18.012161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:18.067309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 91/184] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:18.068240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d60c-b7bb-4044-964a-395c533b90c7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.155795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 94/185] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:18.159182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12921-fd98-4633-9271-062428832d4a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.159474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12921-fd98-4633-9271-062428832d4a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.160424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12921-fd98-4633-9271-062428832d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.183508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d4b12921-fd98-4633-9271-062428832d4a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:18.184753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d4b12921-fd98-4633-9271-062428832d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:18.185232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:18.211959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0801d60c-b7bb-4044-964a-395c533b90c7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:18.265514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb9df8-5253-4e85-b4ce-ccecf48c30a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:18.266487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb9df8-5253-4e85-b4ce-ccecf48c30a0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.266768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb9df8-5253-4e85-b4ce-ccecf48c30a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.267040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb9df8-5253-4e85-b4ce-ccecf48c30a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.279450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb9df8-5253-4e85-b4ce-ccecf48c30a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:18.281215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 95/186] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-39bb9df8-5253-4e85-b4ce-ccecf48c30a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:18.284447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:18.285892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:18.286723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 92/187] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:18.287981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b12921-fd98-4633-9271-062428832d4a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.292780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb9df8-5253-4e85-b4ce-ccecf48c30a0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.344179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:18.402641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb9df8-5253-4e85-b4ce-ccecf48c30a0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:18.412782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b12921-fd98-4633-9271-062428832d4a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:18.438349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c7b6-1266-4805-ad2e-0f6f67d5685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:18.438984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c7b6-1266-4805-ad2e-0f6f67d5685f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.439266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c7b6-1266-4805-ad2e-0f6f67d5685f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.439546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c7b6-1266-4805-ad2e-0f6f67d5685f None admin] PATH_INFO: `/v3/projects/2535fb8628c54af3a2a048b1e3381357` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.440727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c7b6-1266-4805-ad2e-0f6f67d5685f None admin] RBAC: Authorizing `identity:get_project(project_id=2535fb8628c54af3a2a048b1e3381357)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:18.442807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c7b6-1266-4805-ad2e-0f6f67d5685f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:18.444649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 93/188] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/projects/2535fb8628c54af3a2a048b1e3381357 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:18.445886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c7b6-1266-4805-ad2e-0f6f67d5685f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.448261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:18.456325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0e46-824e-42db-98b9-f697cfc53a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:18.457325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e46-824e-42db-98b9-f697cfc53a02 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.457325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e46-824e-42db-98b9-f697cfc53a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.457584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c0e46-824e-42db-98b9-f697cfc53a02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.468578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c0e46-824e-42db-98b9-f697cfc53a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b04c0e46-824e-42db-98b9-f697cfc53a02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:18.473581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:18.474468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:18.475240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 96/189] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:18.475946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0e46-824e-42db-98b9-f697cfc53a02 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.565605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c7b6-1266-4805-ad2e-0f6f67d5685f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:18.587396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:18.591004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c0e46-824e-42db-98b9-f697cfc53a02 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:18.602354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:18.603057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.603375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.603756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.604544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:18.604856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:18.606547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:18.615477 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 94/190] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:18.616309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.626800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41accaa7-2c6d-4c2e-b8e8-ab6ab2ced7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:18.627435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41accaa7-2c6d-4c2e-b8e8-ab6ab2ced7ed None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.627717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41accaa7-2c6d-4c2e-b8e8-ab6ab2ced7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.628018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41accaa7-2c6d-4c2e-b8e8-ab6ab2ced7ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.639618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41accaa7-2c6d-4c2e-b8e8-ab6ab2ced7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-41accaa7-2c6d-4c2e-b8e8-ab6ab2ced7ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:18.645116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:18.646095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:18.646901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 97/191] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:18.647583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41accaa7-2c6d-4c2e-b8e8-ab6ab2ced7ed None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.685931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:18.725448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab9b51-dfac-4450-b690-7783ff529dee None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:18.763434 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41accaa7-2c6d-4c2e-b8e8-ab6ab2ced7ed None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:18.764354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:18.764978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.765261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.765550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.766279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] RBAC: Adding query filter params (role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=2535fb8628c54af3a2a048b1e3381357, user.id=00371932fc0e4504a658ef41b1609571) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:18.766588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:18.768059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:18.776912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 95/192] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/role_assignments?user.id=00371932fc0e4504a658ef41b1609571&scope.project.id=2535fb8628c54af3a2a048b1e3381357&role.id=cf033ca534d941b5b3284c687e715647 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:18.778505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.813134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:18.813761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.814054 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.814338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.815031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:18.815341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:18.817530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:18.838441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 98/193] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:18.838441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.867066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:18.920630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a38a0-6672-405a-b0f8-ec3bf05df543 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:18.953750 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:18.963584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88222e1f-2fdd-4fe0-910a-f8cdf7e99c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:18.969089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88222e1f-2fdd-4fe0-910a-f8cdf7e99c43 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:18.969089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88222e1f-2fdd-4fe0-910a-f8cdf7e99c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:18.969089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88222e1f-2fdd-4fe0-910a-f8cdf7e99c43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:18.969089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88222e1f-2fdd-4fe0-910a-f8cdf7e99c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:18.969089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88222e1f-2fdd-4fe0-910a-f8cdf7e99c43 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:18.969619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 96/194] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:18.969977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88222e1f-2fdd-4fe0-910a-f8cdf7e99c43 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:18.970576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42593d-4e00-4a44-8003-a12ad0e648c7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.020271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d6244-dbe6-4603-afda-b01060918b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.021304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d6244-dbe6-4603-afda-b01060918b54 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.021804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d6244-dbe6-4603-afda-b01060918b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.022085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d6244-dbe6-4603-afda-b01060918b54 None admin] PATH_INFO: `/v3/users/21aea337447742a5a1dc4e6a4c247794` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:19.038708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d6244-dbe6-4603-afda-b01060918b54 None admin] RBAC: Authorizing `identity:get_user(user_id=21aea337447742a5a1dc4e6a4c247794)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:19.041352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d6244-dbe6-4603-afda-b01060918b54 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:19.045823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 99/195] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/users/21aea337447742a5a1dc4e6a4c247794 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:19.046612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d6244-dbe6-4603-afda-b01060918b54 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:19.084808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88222e1f-2fdd-4fe0-910a-f8cdf7e99c43 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.118530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.119135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.119417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.119693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:19.120382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:19.120687 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:19.122042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:19.127602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:19.130871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 97/196] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:19.131651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:19.153339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d6244-dbe6-4603-afda-b01060918b54 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.191971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdcc00-795c-4d8a-b5fc-ce8b297d5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.192621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdcc00-795c-4d8a-b5fc-ce8b297d5968 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.192903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdcc00-795c-4d8a-b5fc-ce8b297d5968 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.193182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdcc00-795c-4d8a-b5fc-ce8b297d5968 None admin] PATH_INFO: `/v3/users/21aea337447742a5a1dc4e6a4c247794` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:19.194334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdcc00-795c-4d8a-b5fc-ce8b297d5968 None admin] RBAC: Authorizing `identity:get_user(user_id=21aea337447742a5a1dc4e6a4c247794)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:19.194650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:19.196075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdcc00-795c-4d8a-b5fc-ce8b297d5968 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:19.197661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 100/197] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:19 2022] GET /identity/v3/users/21aea337447742a5a1dc4e6a4c247794 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:19.203257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdcc00-795c-4d8a-b5fc-ce8b297d5968 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:19.239330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e65fb3-5a70-4c51-9a3e-82458633f36c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.275148 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78494f-c8ed-4940-9351-8228030af6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.276183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78494f-c8ed-4940-9351-8228030af6d4 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.276472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78494f-c8ed-4940-9351-8228030af6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.276751 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78494f-c8ed-4940-9351-8228030af6d4 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:19.277773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78494f-c8ed-4940-9351-8228030af6d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:19.279535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78494f-c8ed-4940-9351-8228030af6d4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:19.301186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdcc00-795c-4d8a-b5fc-ce8b297d5968 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.335242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eaade-172a-499d-9848-7184852cbedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.335863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eaade-172a-499d-9848-7184852cbedd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.336142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eaade-172a-499d-9848-7184852cbedd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.336410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eaade-172a-499d-9848-7184852cbedd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:19.352055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:19.385240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 98/198] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:19 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:19.400865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78494f-c8ed-4940-9351-8228030af6d4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:19.406125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eaade-172a-499d-9848-7184852cbedd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:19.407684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eaade-172a-499d-9848-7184852cbedd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:19.530218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 101/199] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:19.530987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eaade-172a-499d-9848-7184852cbedd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:19.539250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78494f-c8ed-4940-9351-8228030af6d4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.560322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:19.587609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3b25b-acd2-4334-9169-971636f68a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.588297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3b25b-acd2-4334-9169-971636f68a04 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.588581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3b25b-acd2-4334-9169-971636f68a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.588851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e3b25b-acd2-4334-9169-971636f68a04 None admin] PATH_INFO: `/v3/users/301725fa7f074a98a5ac4e8962073092` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:19.590971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3b25b-acd2-4334-9169-971636f68a04 None admin] RBAC: Authorizing `identity:get_user(user_id=301725fa7f074a98a5ac4e8962073092)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:19.592480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e3b25b-acd2-4334-9169-971636f68a04 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:19.594280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 99/200] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:19 2022] GET /identity/v3/users/301725fa7f074a98a5ac4e8962073092 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:19.594967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3b25b-acd2-4334-9169-971636f68a04 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:19.601311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:19.674161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eaade-172a-499d-9848-7184852cbedd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.723264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6193-80b8-4cb9-b6f2-b6e13ff0ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.724593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6193-80b8-4cb9-b6f2-b6e13ff0ea8e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.724593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6193-80b8-4cb9-b6f2-b6e13ff0ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.724869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6193-80b8-4cb9-b6f2-b6e13ff0ea8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:19.728140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e3b25b-acd2-4334-9169-971636f68a04 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.774442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eafb8-ddb5-4a83-8145-d7944d9bbe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.775087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eafb8-ddb5-4a83-8145-d7944d9bbe93 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.775371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eafb8-ddb5-4a83-8145-d7944d9bbe93 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eafb8-ddb5-4a83-8145-d7944d9bbe93 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:19.776847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eafb8-ddb5-4a83-8145-d7944d9bbe93 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:19.778729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eafb8-ddb5-4a83-8145-d7944d9bbe93 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:19.780991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 100/201] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:19 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:19.781547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eafb8-ddb5-4a83-8145-d7944d9bbe93 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:19.810820 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6193-80b8-4cb9-b6f2-b6e13ff0ea8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:19.812431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6193-80b8-4cb9-b6f2-b6e13ff0ea8e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:19.846724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:19.868773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:19.908630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eafb8-ddb5-4a83-8145-d7944d9bbe93 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:19.946409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 102/202] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:19.946409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6193-80b8-4cb9-b6f2-b6e13ff0ea8e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:19.950458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d6ed7-e1cd-455d-bb22-3a70dc9629b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:19.951392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6ed7-e1cd-455d-bb22-3a70dc9629b0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:19.951924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6ed7-e1cd-455d-bb22-3a70dc9629b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:19.952442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d6ed7-e1cd-455d-bb22-3a70dc9629b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:20.043702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d6ed7-e1cd-455d-bb22-3a70dc9629b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:20.045766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d6ed7-e1cd-455d-bb22-3a70dc9629b0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:20.063195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6193-80b8-4cb9-b6f2-b6e13ff0ea8e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:20.100374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:20.101260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:20.101543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:20.101816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:20.102555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8, user.id=21aea337447742a5a1dc4e6a4c247794) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:20.103127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:20.105206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:20.107802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:20.115650 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 103/203] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:19 2022] GET /identity/v3/role_assignments?user.id=21aea337447742a5a1dc4e6a4c247794&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:20.116578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:20.135792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:20.173182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 101/204] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:20.183457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d6ed7-e1cd-455d-bb22-3a70dc9629b0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:20.266138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04c537-652a-4c33-99a0-21c343ddeba9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:20.307211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e987b7-dd84-4c9e-abab-34ea6de9f5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:20.307952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e987b7-dd84-4c9e-abab-34ea6de9f5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:20.308359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e987b7-dd84-4c9e-abab-34ea6de9f5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:20.308643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e987b7-dd84-4c9e-abab-34ea6de9f5b0 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:20.310053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e987b7-dd84-4c9e-abab-34ea6de9f5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:20.311524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e987b7-dd84-4c9e-abab-34ea6de9f5b0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:20.313978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 104/205] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:20 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:20.325783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e987b7-dd84-4c9e-abab-34ea6de9f5b0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:20.429120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d6ed7-e1cd-455d-bb22-3a70dc9629b0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:20.496094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:20.521816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e987b7-dd84-4c9e-abab-34ea6de9f5b0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:20.545892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc200613-a12f-4c57-97a8-20b8f63a082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:20.546577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc200613-a12f-4c57-97a8-20b8f63a082a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:20.546887 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc200613-a12f-4c57-97a8-20b8f63a082a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:20.547112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc200613-a12f-4c57-97a8-20b8f63a082a None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:20.552613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc200613-a12f-4c57-97a8-20b8f63a082a None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:20.554107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc200613-a12f-4c57-97a8-20b8f63a082a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:20.555880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 102/206] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:20 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:20.563845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc200613-a12f-4c57-97a8-20b8f63a082a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:20.573461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bc0ef-00a0-45ec-93cd-a18a71ab0e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:20.574516 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bc0ef-00a0-45ec-93cd-a18a71ab0e3d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:20.574797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bc0ef-00a0-45ec-93cd-a18a71ab0e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:20.575067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bc0ef-00a0-45ec-93cd-a18a71ab0e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:20.575861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bc0ef-00a0-45ec-93cd-a18a71ab0e3d None admin] RBAC: Adding query filter params (role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8, user.id=21aea337447742a5a1dc4e6a4c247794) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:20.576172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bc0ef-00a0-45ec-93cd-a18a71ab0e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:20.577708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bc0ef-00a0-45ec-93cd-a18a71ab0e3d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:20.588406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:20.595753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 105/207] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:20 2022] GET /identity/v3/role_assignments?user.id=21aea337447742a5a1dc4e6a4c247794&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=d2a640c46df448be87633e4dd910c74f => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:20.718281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc200613-a12f-4c57-97a8-20b8f63a082a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:20.777876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2e230-d306-43d3-ad12-f8497999fe25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:20.778507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2e230-d306-43d3-ad12-f8497999fe25 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:20.778772 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2e230-d306-43d3-ad12-f8497999fe25 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:20.779046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2e230-d306-43d3-ad12-f8497999fe25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:20.779813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2e230-d306-43d3-ad12-f8497999fe25 None admin] RBAC: Adding query filter params (role.id=61ad56bfd6a646e19984b23e39b8b664, scope.project.id=370870b74de0407a9d8619b669b6f45f, user.id=301725fa7f074a98a5ac4e8962073092) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:20.780127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2e230-d306-43d3-ad12-f8497999fe25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:20.781587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2e230-d306-43d3-ad12-f8497999fe25 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:20.789468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 103/208] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:20 2022] GET /identity/v3/role_assignments?user.id=301725fa7f074a98a5ac4e8962073092&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=61ad56bfd6a646e19984b23e39b8b664 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:21.638664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226252-9ea4-4066-8b7e-9d7d80ed9808 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:21.639186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226252-9ea4-4066-8b7e-9d7d80ed9808 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:21.639186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71226252-9ea4-4066-8b7e-9d7d80ed9808 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:21.640796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 106/209] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:21.647050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f04c-2753-4c3f-a777-95ec6e99abec None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:21.647336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f04c-2753-4c3f-a777-95ec6e99abec None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:21.647614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f04c-2753-4c3f-a777-95ec6e99abec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:21.666445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0695f04c-2753-4c3f-a777-95ec6e99abec None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:21.667756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0695f04c-2753-4c3f-a777-95ec6e99abec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:21.672524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469a067-b772-4f7c-9015-c569248f4e97 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:21.673002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469a067-b772-4f7c-9015-c569248f4e97 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:21.673480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469a067-b772-4f7c-9015-c569248f4e97 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:21.676394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 107/210] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:21.682524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e38eb-1d36-4007-890e-d15ba014f0da None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:21.682817 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e38eb-1d36-4007-890e-d15ba014f0da None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:21.683163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e38eb-1d36-4007-890e-d15ba014f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:21.709165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c00e38eb-1d36-4007-890e-d15ba014f0da None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:21.711348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c00e38eb-1d36-4007-890e-d15ba014f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:21.758143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 104/211] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:21.796023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 108/212] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:22.045220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f04c-2753-4c3f-a777-95ec6e99abec None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:22.060138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:22.086563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e38eb-1d36-4007-890e-d15ba014f0da None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:22.164799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:22.169907 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f04c-2753-4c3f-a777-95ec6e99abec None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:22.200639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e38eb-1d36-4007-890e-d15ba014f0da None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:22.225689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d039711-3627-4391-a739-501726dc2f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:22.226689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039711-3627-4391-a739-501726dc2f26 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.227234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039711-3627-4391-a739-501726dc2f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.228283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d039711-3627-4391-a739-501726dc2f26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.243115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f545f07-85a0-4896-8348-78662a526964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:22.243457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d039711-3627-4391-a739-501726dc2f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:22.243765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545f07-85a0-4896-8348-78662a526964 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.244064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545f07-85a0-4896-8348-78662a526964 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.244336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f545f07-85a0-4896-8348-78662a526964 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.245437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f545f07-85a0-4896-8348-78662a526964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:22.246867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f545f07-85a0-4896-8348-78662a526964 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:22.248560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 109/213] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6d039711-3627-4391-a739-501726dc2f26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:22.250352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:22.251223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:22.252029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:22.254755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f545f07-85a0-4896-8348-78662a526964 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:22.255210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 105/214] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:22.262344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d039711-3627-4391-a739-501726dc2f26 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:22.339951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:22.374798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d039711-3627-4391-a739-501726dc2f26 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:22.389803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f545f07-85a0-4896-8348-78662a526964 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:22.416650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8a799-a1c7-4ba6-961b-1ca6bd98fbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:22.417258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a799-a1c7-4ba6-961b-1ca6bd98fbed None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.417536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a799-a1c7-4ba6-961b-1ca6bd98fbed None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.417815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8a799-a1c7-4ba6-961b-1ca6bd98fbed None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.418518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8a799-a1c7-4ba6-961b-1ca6bd98fbed None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:22.418819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8a799-a1c7-4ba6-961b-1ca6bd98fbed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:22.420217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8a799-a1c7-4ba6-961b-1ca6bd98fbed None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:22.429533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 106/215] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:22.430857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a0fa-273f-43b9-9d06-c7dc3b3cb0f7 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.431147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a0fa-273f-43b9-9d06-c7dc3b3cb0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.431418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a0fa-273f-43b9-9d06-c7dc3b3cb0f7 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.432809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 107/216] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:22.434809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b45166-b8b8-41c1-b768-6811e7128a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:22.434954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a0fa-273f-43b9-9d06-c7dc3b3cb0f7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:22.435441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b45166-b8b8-41c1-b768-6811e7128a4b None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.435748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b45166-b8b8-41c1-b768-6811e7128a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.436028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b45166-b8b8-41c1-b768-6811e7128a4b None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.436703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b45166-b8b8-41c1-b768-6811e7128a4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:22.438180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b45166-b8b8-41c1-b768-6811e7128a4b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:22.451128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:22.571781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 110/217] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:22 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:22.571781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299b6c-ee4e-4850-9c09-63c9912819f7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.571781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299b6c-ee4e-4850-9c09-63c9912819f7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.571781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5299b6c-ee4e-4850-9c09-63c9912819f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.592769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a0fa-273f-43b9-9d06-c7dc3b3cb0f7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:22.593725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b5299b6c-ee4e-4850-9c09-63c9912819f7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:22.596589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b5299b6c-ee4e-4850-9c09-63c9912819f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:22.639371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88c1a2-17cd-40ef-88a9-9ce84e34f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:22.640080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c1a2-17cd-40ef-88a9-9ce84e34f043 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.640361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c1a2-17cd-40ef-88a9-9ce84e34f043 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.640637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88c1a2-17cd-40ef-88a9-9ce84e34f043 None admin] PATH_INFO: `/v3/users/ade72dbb807a45ab9f55f103429e58f2` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.646234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:22.667719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88c1a2-17cd-40ef-88a9-9ce84e34f043 None admin] RBAC: Authorizing `identity:get_user(user_id=ade72dbb807a45ab9f55f103429e58f2)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:22.669746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca88c1a2-17cd-40ef-88a9-9ce84e34f043 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:22.671686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 108/218] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:22 2022] GET /identity/v3/users/ade72dbb807a45ab9f55f103429e58f2 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:22.678718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88c1a2-17cd-40ef-88a9-9ce84e34f043 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:22.717576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 111/219] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:22.848646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88c1a2-17cd-40ef-88a9-9ce84e34f043 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:22.849224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6488b-f6dc-4c07-979c-beb5b76354be None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.849515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6488b-f6dc-4c07-979c-beb5b76354be None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.849846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6488b-f6dc-4c07-979c-beb5b76354be None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.853295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 112/220] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:22.858777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f11283-529e-4003-84c9-f027ada5a1f4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.859061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f11283-529e-4003-84c9-f027ada5a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.859331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f11283-529e-4003-84c9-f027ada5a1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:22.888862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d6f11283-529e-4003-84c9-f027ada5a1f4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:22.890089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d6f11283-529e-4003-84c9-f027ada5a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:22.912507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c04992-c59b-48cb-a995-41261dd1b39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:22.913849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04992-c59b-48cb-a995-41261dd1b39c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:22.914143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04992-c59b-48cb-a995-41261dd1b39c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:22.914682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c04992-c59b-48cb-a995-41261dd1b39c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:23.025197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 113/221] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:23.034380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:23.049853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f11283-529e-4003-84c9-f027ada5a1f4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:23.053453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c04992-c59b-48cb-a995-41261dd1b39c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:23.054941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c04992-c59b-48cb-a995-41261dd1b39c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:23.142562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:23.203853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 109/222] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:23.211335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c04992-c59b-48cb-a995-41261dd1b39c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:23.251415 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f11283-529e-4003-84c9-f027ada5a1f4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:23.319230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563f5f7-0f77-473e-8c9f-54885f8f292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:23.320243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563f5f7-0f77-473e-8c9f-54885f8f292a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:23.320579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563f5f7-0f77-473e-8c9f-54885f8f292a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:23.321105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563f5f7-0f77-473e-8c9f-54885f8f292a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:23.352890 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563f5f7-0f77-473e-8c9f-54885f8f292a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a563f5f7-0f77-473e-8c9f-54885f8f292a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:23.360479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:23.361436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:23.362299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 114/223] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:23.367751 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563f5f7-0f77-473e-8c9f-54885f8f292a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:23.385830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:23.398548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c04992-c59b-48cb-a995-41261dd1b39c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:23.446248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3695b1d-e58f-4f1b-9921-975ce0d0303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:23.447324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3695b1d-e58f-4f1b-9921-975ce0d0303e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:23.447855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3695b1d-e58f-4f1b-9921-975ce0d0303e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:23.448435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3695b1d-e58f-4f1b-9921-975ce0d0303e None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:23.450850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3695b1d-e58f-4f1b-9921-975ce0d0303e None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:23.452947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3695b1d-e58f-4f1b-9921-975ce0d0303e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:23.455095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 110/224] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:23 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:23.456251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3695b1d-e58f-4f1b-9921-975ce0d0303e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:23.485587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563f5f7-0f77-473e-8c9f-54885f8f292a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:23.524103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:23.534406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3369-1fb3-450b-958b-320b86c81450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:23.537539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3369-1fb3-450b-958b-320b86c81450 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:23.537539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3369-1fb3-450b-958b-320b86c81450 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:23.537539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a3369-1fb3-450b-958b-320b86c81450 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:23.547935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a3369-1fb3-450b-958b-320b86c81450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-240a3369-1fb3-450b-958b-320b86c81450 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:23.553884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:23.554965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:23.555937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:23.558354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 115/225] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:23.559514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3369-1fb3-450b-958b-320b86c81450 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:23.601543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3695b1d-e58f-4f1b-9921-975ce0d0303e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:23.645255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:23.646180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:23.646678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:23.647155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:23.648056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:23.648629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:23.650193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:23.659033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 111/226] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:23.660802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:23.687591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:23.708512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a3369-1fb3-450b-958b-320b86c81450 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:23.746485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:23.747979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:23.748459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:23.748941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:23.749855 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] RBAC: Adding query filter params (role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8, user.id=ade72dbb807a45ab9f55f103429e58f2) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:23.750376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:23.752263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:23.758892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 116/227] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:23 2022] GET /identity/v3/role_assignments?user.id=ade72dbb807a45ab9f55f103429e58f2&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=cf033ca534d941b5b3284c687e715647 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:23.760040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:23.783779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a816b-b879-46df-9721-2a3b3f01b5d6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:23.818666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:23.826214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:23.827063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:23.827502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:23.827974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:23.831778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:23.831778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:23.831778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:23.840382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 112/228] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:23.846843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:23.958344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f144b-79b4-4554-889c-83b64526be38 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:23.966875 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:23.986102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d34825-5ad3-4cd3-82fd-d15f50b84085 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:23.999780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae6c0-da65-4884-be3d-a4d984bbc6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:24.000864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae6c0-da65-4884-be3d-a4d984bbc6df None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:24.000864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae6c0-da65-4884-be3d-a4d984bbc6df None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:24.001079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ae6c0-da65-4884-be3d-a4d984bbc6df None admin] PATH_INFO: `/v3/users/21aea337447742a5a1dc4e6a4c247794` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:24.002341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae6c0-da65-4884-be3d-a4d984bbc6df None admin] RBAC: Authorizing `identity:get_user(user_id=21aea337447742a5a1dc4e6a4c247794)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:24.004352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ae6c0-da65-4884-be3d-a4d984bbc6df None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:24.006474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 117/229] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:23 2022] GET /identity/v3/users/21aea337447742a5a1dc4e6a4c247794 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:24.012498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae6c0-da65-4884-be3d-a4d984bbc6df None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:24.049437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22c22c-e04e-4c3f-99e9-b910b08cd5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:24.050745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c22c-e04e-4c3f-99e9-b910b08cd5de None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:24.051028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c22c-e04e-4c3f-99e9-b910b08cd5de None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:24.051308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22c22c-e04e-4c3f-99e9-b910b08cd5de None admin] PATH_INFO: `/v3/users/21aea337447742a5a1dc4e6a4c247794` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:24.053213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22c22c-e04e-4c3f-99e9-b910b08cd5de None admin] RBAC: Authorizing `identity:get_user(user_id=21aea337447742a5a1dc4e6a4c247794)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:24.054670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22c22c-e04e-4c3f-99e9-b910b08cd5de None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:24.057698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 113/230] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:23 2022] GET /identity/v3/users/21aea337447742a5a1dc4e6a4c247794 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:24.064811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22c22c-e04e-4c3f-99e9-b910b08cd5de None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:24.220064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ae6c0-da65-4884-be3d-a4d984bbc6df None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:24.235424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:24.259387 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22c22c-e04e-4c3f-99e9-b910b08cd5de None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:24.294182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39016ae-cae2-4e1f-bb1b-99e2c66d215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:24.294816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39016ae-cae2-4e1f-bb1b-99e2c66d215a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:24.295098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39016ae-cae2-4e1f-bb1b-99e2c66d215a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:24.295372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39016ae-cae2-4e1f-bb1b-99e2c66d215a None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:24.297168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39016ae-cae2-4e1f-bb1b-99e2c66d215a None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:24.299715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39016ae-cae2-4e1f-bb1b-99e2c66d215a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:24.304147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 118/231] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:24 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:24.309959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39016ae-cae2-4e1f-bb1b-99e2c66d215a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:24.327546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cafca-dd5f-4ee4-a6ae-4c1c1e8ca490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:24.328211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cafca-dd5f-4ee4-a6ae-4c1c1e8ca490 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:24.328544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cafca-dd5f-4ee4-a6ae-4c1c1e8ca490 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:24.328821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cafca-dd5f-4ee4-a6ae-4c1c1e8ca490 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:24.329970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cafca-dd5f-4ee4-a6ae-4c1c1e8ca490 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:24.333389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cafca-dd5f-4ee4-a6ae-4c1c1e8ca490 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:24.335126 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 114/232] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:24 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:24.340726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cafca-dd5f-4ee4-a6ae-4c1c1e8ca490 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:24.376111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:24.453679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cafca-dd5f-4ee4-a6ae-4c1c1e8ca490 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:24.490004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d64224-6929-4eb6-8663-a1fef36e6fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:24.490595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d64224-6929-4eb6-8663-a1fef36e6fb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:24.490874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d64224-6929-4eb6-8663-a1fef36e6fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:24.491165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d64224-6929-4eb6-8663-a1fef36e6fb2 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/users/21aea337447742a5a1dc4e6a4c247794/roles/d2a640c46df448be87633e4dd910c74f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:24.497938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d64224-6929-4eb6-8663-a1fef36e6fb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c080bc0c25374fe7867a8a2a06a093a8, user_id=21aea337447742a5a1dc4e6a4c247794, role_id=d2a640c46df448be87633e4dd910c74f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:24.499377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d64224-6929-4eb6-8663-a1fef36e6fb2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:24.526147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39016ae-cae2-4e1f-bb1b-99e2c66d215a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:24.562697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffd6e9-28cd-4c6e-b21e-12574638e84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:24.563408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd6e9-28cd-4c6e-b21e-12574638e84f None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:24.563695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd6e9-28cd-4c6e-b21e-12574638e84f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:24.563996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffd6e9-28cd-4c6e-b21e-12574638e84f None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/users/21aea337447742a5a1dc4e6a4c247794/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:24.566788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd6e9-28cd-4c6e-b21e-12574638e84f None admin] RBAC: Authorizing `identity:create_grant(project_id=c080bc0c25374fe7867a8a2a06a093a8, user_id=21aea337447742a5a1dc4e6a4c247794, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:24.568353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffd6e9-28cd-4c6e-b21e-12574638e84f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:24.591584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 115/233] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:24 2022] PUT /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/users/21aea337447742a5a1dc4e6a4c247794/roles/d2a640c46df448be87633e4dd910c74f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:24.650690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 119/234] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:24 2022] PUT /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/users/21aea337447742a5a1dc4e6a4c247794/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:25.123206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e1f8-7db0-4b34-baad-4f91cf05b5d3 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:25.124231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e1f8-7db0-4b34-baad-4f91cf05b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:25.124521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9e1f8-7db0-4b34-baad-4f91cf05b5d3 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:25.126071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 116/235] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:25.132527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e4d7-8b98-4bf7-9c98-94105bab7382 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:25.133062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e4d7-8b98-4bf7-9c98-94105bab7382 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:25.133062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e4d7-8b98-4bf7-9c98-94105bab7382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:25.169072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1a82e4d7-8b98-4bf7-9c98-94105bab7382 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:25.170553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1a82e4d7-8b98-4bf7-9c98-94105bab7382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:25.216793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:25.252831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef553dc-989f-4007-a1e1-09ad54046c2c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:25.253923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef553dc-989f-4007-a1e1-09ad54046c2c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:25.254237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef553dc-989f-4007-a1e1-09ad54046c2c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:25.260106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 117/236] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:25.271423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed6e1e-1f88-4f6a-9f13-3a61e00ee6eb None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:25.274936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed6e1e-1f88-4f6a-9f13-3a61e00ee6eb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:25.274936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed6e1e-1f88-4f6a-9f13-3a61e00ee6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:25.275108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 120/237] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:25.301942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-37ed6e1e-1f88-4f6a-9f13-3a61e00ee6eb None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:25.303146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-37ed6e1e-1f88-4f6a-9f13-3a61e00ee6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:25.389381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 118/238] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:25.621798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e4d7-8b98-4bf7-9c98-94105bab7382 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:25.659788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed6e1e-1f88-4f6a-9f13-3a61e00ee6eb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:25.671743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:25.738859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e4d7-8b98-4bf7-9c98-94105bab7382 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:25.783243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72e1d7-74ff-4e6c-b335-272e3bc836e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:25.783919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e1d7-74ff-4e6c-b335-272e3bc836e9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:25.784243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e1d7-74ff-4e6c-b335-272e3bc836e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:25.784903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72e1d7-74ff-4e6c-b335-272e3bc836e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:25.789509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72e1d7-74ff-4e6c-b335-272e3bc836e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:25.790974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72e1d7-74ff-4e6c-b335-272e3bc836e9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:25.793853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 121/239] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:25.801214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72e1d7-74ff-4e6c-b335-272e3bc836e9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:25.834084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed6e1e-1f88-4f6a-9f13-3a61e00ee6eb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:25.864920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:25.894928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860fdb-2ca1-4cdd-825c-8e6dfff5f039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:25.895577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860fdb-2ca1-4cdd-825c-8e6dfff5f039 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:25.895909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860fdb-2ca1-4cdd-825c-8e6dfff5f039 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:25.896189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30860fdb-2ca1-4cdd-825c-8e6dfff5f039 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:25.907857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30860fdb-2ca1-4cdd-825c-8e6dfff5f039 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-30860fdb-2ca1-4cdd-825c-8e6dfff5f039 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:25.913522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:25.914389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:25.915179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 119/240] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:25.924644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860fdb-2ca1-4cdd-825c-8e6dfff5f039 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:25.986406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72e1d7-74ff-4e6c-b335-272e3bc836e9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:26.031612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c58c6-de77-4bdc-b0e4-563ae8d01539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:26.033888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c58c6-de77-4bdc-b0e4-563ae8d01539 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:26.034708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c58c6-de77-4bdc-b0e4-563ae8d01539 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:26.035792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c58c6-de77-4bdc-b0e4-563ae8d01539 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:26.036859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c58c6-de77-4bdc-b0e4-563ae8d01539 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:26.039061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c58c6-de77-4bdc-b0e4-563ae8d01539 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:26.054596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:26.087841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30860fdb-2ca1-4cdd-825c-8e6dfff5f039 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:26.123454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:26.124895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:26.125382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:26.125934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:26.126807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:26.127313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:26.129910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:26.139050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 120/241] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:26.150586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:26.168480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 122/242] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:25 2022] POST /identity/v3/users => generated 293 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:26.242235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5d40-4a2d-4e2b-a856-d8fbd626b1b5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:26.242585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5d40-4a2d-4e2b-a856-d8fbd626b1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:26.242786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca5d40-4a2d-4e2b-a856-d8fbd626b1b5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:26.244282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 123/243] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:26.251707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496354a-1837-4418-b3c8-1e0a356a74d3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:26.252014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496354a-1837-4418-b3c8-1e0a356a74d3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:26.252356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496354a-1837-4418-b3c8-1e0a356a74d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:26.280318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2496354a-1837-4418-b3c8-1e0a356a74d3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:26.281584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2496354a-1837-4418-b3c8-1e0a356a74d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:26.364095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012880d-0100-4d4f-9d90-bd9119aa0a61 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:26.395580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:26.399076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 124/244] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:26.403810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37a0c-8f14-4305-9b1d-ea1603a34110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:26.403810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37a0c-8f14-4305-9b1d-ea1603a34110 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:26.403810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37a0c-8f14-4305-9b1d-ea1603a34110 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:26.403810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd37a0c-8f14-4305-9b1d-ea1603a34110 None admin] PATH_INFO: `/v3/users/d3184598982e478c9638cadd332c52e9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:26.417636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd37a0c-8f14-4305-9b1d-ea1603a34110 None admin] RBAC: Authorizing `identity:get_user(user_id=d3184598982e478c9638cadd332c52e9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:26.419294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd37a0c-8f14-4305-9b1d-ea1603a34110 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:26.425928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 121/245] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:26 2022] GET /identity/v3/users/d3184598982e478c9638cadd332c52e9 => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:26.427403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496354a-1837-4418-b3c8-1e0a356a74d3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:26.451684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:26.538013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496354a-1837-4418-b3c8-1e0a356a74d3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:26.576560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67ba8b-bcfe-4327-92da-bb84782132de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:26.577174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67ba8b-bcfe-4327-92da-bb84782132de None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:26.577451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67ba8b-bcfe-4327-92da-bb84782132de None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:26.577724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67ba8b-bcfe-4327-92da-bb84782132de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:26.652384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67ba8b-bcfe-4327-92da-bb84782132de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:26.653938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67ba8b-bcfe-4327-92da-bb84782132de None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:26.678504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:26.697982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37a0c-8f14-4305-9b1d-ea1603a34110 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:26.793487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 125/246] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:26.799595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67ba8b-bcfe-4327-92da-bb84782132de None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:26.820542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd37a0c-8f14-4305-9b1d-ea1603a34110 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:26.866027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1573f5-9b2b-4a5b-90cc-e34a124cf177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:26.866730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1573f5-9b2b-4a5b-90cc-e34a124cf177 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:26.867003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1573f5-9b2b-4a5b-90cc-e34a124cf177 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:26.867280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1573f5-9b2b-4a5b-90cc-e34a124cf177 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:26.880614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1573f5-9b2b-4a5b-90cc-e34a124cf177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4c1573f5-9b2b-4a5b-90cc-e34a124cf177 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:26.885537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:26.886417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:26.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 122/247] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:26.893229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1573f5-9b2b-4a5b-90cc-e34a124cf177 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:26.943693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67ba8b-bcfe-4327-92da-bb84782132de None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:26.964023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:26.970808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:26.999682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d1bce-576c-441d-99a1-ece6f01d68c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:27.000290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1bce-576c-441d-99a1-ece6f01d68c1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.000575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1bce-576c-441d-99a1-ece6f01d68c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.000854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d1bce-576c-441d-99a1-ece6f01d68c1 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.008391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d1bce-576c-441d-99a1-ece6f01d68c1 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:27.009859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d1bce-576c-441d-99a1-ece6f01d68c1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:27.011855 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 126/248] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:26 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:27.019456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d1bce-576c-441d-99a1-ece6f01d68c1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:27.056897 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1573f5-9b2b-4a5b-90cc-e34a124cf177 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:27.104317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53a4c-8fa8-4e22-a88e-80eb0b7efb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:27.105587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53a4c-8fa8-4e22-a88e-80eb0b7efb15 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.105881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53a4c-8fa8-4e22-a88e-80eb0b7efb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.106159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53a4c-8fa8-4e22-a88e-80eb0b7efb15 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.107216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53a4c-8fa8-4e22-a88e-80eb0b7efb15 None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:27.107522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53a4c-8fa8-4e22-a88e-80eb0b7efb15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:27.109639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53a4c-8fa8-4e22-a88e-80eb0b7efb15 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:27.120596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 123/249] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:27.121849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b08a-a887-4434-b67c-3a310183801a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.122140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b08a-a887-4434-b67c-3a310183801a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.122421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19b08a-a887-4434-b67c-3a310183801a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.128198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 124/250] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:27.129989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19b08a-a887-4434-b67c-3a310183801a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:27.177738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d1bce-576c-441d-99a1-ece6f01d68c1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:27.228798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80233f5a-90ad-418d-823f-e84e72f387c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:27.229540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80233f5a-90ad-418d-823f-e84e72f387c7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.229824 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80233f5a-90ad-418d-823f-e84e72f387c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.230103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80233f5a-90ad-418d-823f-e84e72f387c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.230841 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80233f5a-90ad-418d-823f-e84e72f387c7 None admin] RBAC: Adding query filter params (role.id=61ad56bfd6a646e19984b23e39b8b664, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8, user.id=d3184598982e478c9638cadd332c52e9) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:27.231155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80233f5a-90ad-418d-823f-e84e72f387c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:27.232648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80233f5a-90ad-418d-823f-e84e72f387c7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:27.243755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 127/251] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:27 2022] GET /identity/v3/role_assignments?user.id=d3184598982e478c9638cadd332c52e9&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=61ad56bfd6a646e19984b23e39b8b664 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:27.243755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c23b4-9460-4d35-9a27-3d72b4255602 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.243755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c23b4-9460-4d35-9a27-3d72b4255602 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.243755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c23b4-9460-4d35-9a27-3d72b4255602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.277000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3c6c23b4-9460-4d35-9a27-3d72b4255602 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:27.278619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3c6c23b4-9460-4d35-9a27-3d72b4255602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:27.336636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19b08a-a887-4434-b67c-3a310183801a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:27.356242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:27.379910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:27.382981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c71664-c641-4a87-bb9a-19d80edb65fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:27.383889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c71664-c641-4a87-bb9a-19d80edb65fc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.384321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c71664-c641-4a87-bb9a-19d80edb65fc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.384742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c71664-c641-4a87-bb9a-19d80edb65fc None admin] PATH_INFO: `/v3/users/ade72dbb807a45ab9f55f103429e58f2` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.386074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c71664-c641-4a87-bb9a-19d80edb65fc None admin] RBAC: Authorizing `identity:get_user(user_id=ade72dbb807a45ab9f55f103429e58f2)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:27.387715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c71664-c641-4a87-bb9a-19d80edb65fc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:27.390105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 125/252] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:27 2022] GET /identity/v3/users/ade72dbb807a45ab9f55f103429e58f2 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:27.396199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e7fc-f81d-4ffe-a643-2f6380a1bbe7 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.397155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e7fc-f81d-4ffe-a643-2f6380a1bbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.397594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05e7fc-f81d-4ffe-a643-2f6380a1bbe7 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.399446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 126/253] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:27.400841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05e7fc-f81d-4ffe-a643-2f6380a1bbe7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:27.419904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 128/254] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:27.421249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3fb2-a8a1-4040-a30d-8129a06e9542 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.421604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3fb2-a8a1-4040-a30d-8129a06e9542 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.421955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3fb2-a8a1-4040-a30d-8129a06e9542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.508752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5f5d3fb2-a8a1-4040-a30d-8129a06e9542 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:27.510262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5f5d3fb2-a8a1-4040-a30d-8129a06e9542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:27.527197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05e7fc-f81d-4ffe-a643-2f6380a1bbe7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:27.563834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103898c-99f0-460e-b2d6-d7c34a8cdd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:27.564482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103898c-99f0-460e-b2d6-d7c34a8cdd5c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.564765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103898c-99f0-460e-b2d6-d7c34a8cdd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.565041 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103898c-99f0-460e-b2d6-d7c34a8cdd5c None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.566252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103898c-99f0-460e-b2d6-d7c34a8cdd5c None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:27.567936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103898c-99f0-460e-b2d6-d7c34a8cdd5c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:27.570301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 127/255] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:27 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:27.576939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103898c-99f0-460e-b2d6-d7c34a8cdd5c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:27.635055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 129/256] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:27.648480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:27.706916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103898c-99f0-460e-b2d6-d7c34a8cdd5c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:27.742891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805265f5-74d1-4821-aab1-06b6add3e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:27.743559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805265f5-74d1-4821-aab1-06b6add3e669 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:27.743914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805265f5-74d1-4821-aab1-06b6add3e669 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:27.744194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805265f5-74d1-4821-aab1-06b6add3e669 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/users/ade72dbb807a45ab9f55f103429e58f2/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:27.746135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805265f5-74d1-4821-aab1-06b6add3e669 None admin] RBAC: Authorizing `identity:create_grant(project_id=c080bc0c25374fe7867a8a2a06a093a8, user_id=ade72dbb807a45ab9f55f103429e58f2, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:27.747568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805265f5-74d1-4821-aab1-06b6add3e669 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:27.813590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 128/257] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:27 2022] PUT /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/users/ade72dbb807a45ab9f55f103429e58f2/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 18:57:27.898203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d3fb2-a8a1-4040-a30d-8129a06e9542 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:28.019354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d3fb2-a8a1-4040-a30d-8129a06e9542 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:28.034498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:28.042747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805265f5-74d1-4821-aab1-06b6add3e669 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:28.059591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08c9cc-cfd6-4442-8926-3d7f3d5c6ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:28.060587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08c9cc-cfd6-4442-8926-3d7f3d5c6ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:28.061043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08c9cc-cfd6-4442-8926-3d7f3d5c6ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:28.061486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08c9cc-cfd6-4442-8926-3d7f3d5c6ea0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:28.077761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08c9cc-cfd6-4442-8926-3d7f3d5c6ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5a08c9cc-cfd6-4442-8926-3d7f3d5c6ea0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:28.088560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:28.089471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:28.090239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:28.092671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 130/258] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:28.099182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08c9cc-cfd6-4442-8926-3d7f3d5c6ea0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:28.164508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805265f5-74d1-4821-aab1-06b6add3e669 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:28.174545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:28.209890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aee25-da62-4f91-91cd-7209076763f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:28.210555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aee25-da62-4f91-91cd-7209076763f5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:28.210844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aee25-da62-4f91-91cd-7209076763f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:28.211123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aee25-da62-4f91-91cd-7209076763f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:28.234022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aee25-da62-4f91-91cd-7209076763f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6a3aee25-da62-4f91-91cd-7209076763f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:28.247013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:28.247961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:28.249361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 129/259] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:28.255469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aee25-da62-4f91-91cd-7209076763f5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:28.357718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08c9cc-cfd6-4442-8926-3d7f3d5c6ea0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:28.378763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aee25-da62-4f91-91cd-7209076763f5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:28.422335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:28.423103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:28.423421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:28.423902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:28.424629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:28.425412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:28.426914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:28.439264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 130/260] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:28.439580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:28.440592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:28.441198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:28.441647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:28.443035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:28.447748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:28.448138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:28.452283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:28.472550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 131/261] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:28.487948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:28.520087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:28.553188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:28.656508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491387b-f1d9-45c8-98e0-423197c3f645 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:28.693922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d6a55-eb10-4c01-8b1a-b355149d42a9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:28.706237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f8fa7-2e59-457b-98d9-f9f59c31ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:28.707039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8fa7-2e59-457b-98d9-f9f59c31ad12 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:28.707331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8fa7-2e59-457b-98d9-f9f59c31ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:28.707612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f8fa7-2e59-457b-98d9-f9f59c31ad12 None admin] PATH_INFO: `/v3/users/21aea337447742a5a1dc4e6a4c247794` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:28.708825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8fa7-2e59-457b-98d9-f9f59c31ad12 None admin] RBAC: Authorizing `identity:get_user(user_id=21aea337447742a5a1dc4e6a4c247794)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:28.710272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f8fa7-2e59-457b-98d9-f9f59c31ad12 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:28.712430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 131/262] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:28 2022] GET /identity/v3/users/21aea337447742a5a1dc4e6a4c247794 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:28.718247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f8fa7-2e59-457b-98d9-f9f59c31ad12 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:28.767620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992589-c744-43de-ac73-5be4506dfe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:28.769445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992589-c744-43de-ac73-5be4506dfe7e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:28.769954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992589-c744-43de-ac73-5be4506dfe7e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:28.770401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f992589-c744-43de-ac73-5be4506dfe7e None admin] PATH_INFO: `/v3/users/21aea337447742a5a1dc4e6a4c247794` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:28.773496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f992589-c744-43de-ac73-5be4506dfe7e None admin] RBAC: Authorizing `identity:get_user(user_id=21aea337447742a5a1dc4e6a4c247794)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:28.775234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f992589-c744-43de-ac73-5be4506dfe7e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:28.777339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 132/263] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:28 2022] GET /identity/v3/users/21aea337447742a5a1dc4e6a4c247794 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:28.784328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992589-c744-43de-ac73-5be4506dfe7e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:28.833212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f8fa7-2e59-457b-98d9-f9f59c31ad12 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:28.835062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:28.868919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567f2d3-3a60-4d9b-8b2a-5080f9d52a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:28.869911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567f2d3-3a60-4d9b-8b2a-5080f9d52a2c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:28.870405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567f2d3-3a60-4d9b-8b2a-5080f9d52a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:28.870904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567f2d3-3a60-4d9b-8b2a-5080f9d52a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:28.950316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567f2d3-3a60-4d9b-8b2a-5080f9d52a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:28.952179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567f2d3-3a60-4d9b-8b2a-5080f9d52a2c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:28.969559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f992589-c744-43de-ac73-5be4506dfe7e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:28.971286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:29.039825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8a96-79b5-47a6-b1d0-d3d5d2b06bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:29.040450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8a96-79b5-47a6-b1d0-d3d5d2b06bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.040732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8a96-79b5-47a6-b1d0-d3d5d2b06bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8a96-79b5-47a6-b1d0-d3d5d2b06bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.056107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:29.060467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 132/264] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:57:29.066421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567f2d3-3a60-4d9b-8b2a-5080f9d52a2c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:29.178948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567f2d3-3a60-4d9b-8b2a-5080f9d52a2c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:29.199880 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a8a96-79b5-47a6-b1d0-d3d5d2b06bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:29.208032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a8a96-79b5-47a6-b1d0-d3d5d2b06bd3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:29.219886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e6e0-781f-46e2-ace6-195b07ce98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:29.220529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e6e0-781f-46e2-ace6-195b07ce98bf None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.220818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e6e0-781f-46e2-ace6-195b07ce98bf None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.221095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216e6e0-781f-46e2-ace6-195b07ce98bf None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.222808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216e6e0-781f-46e2-ace6-195b07ce98bf None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:29.224466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216e6e0-781f-46e2-ace6-195b07ce98bf None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:29.226492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 133/265] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:29 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:29.232212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e6e0-781f-46e2-ace6-195b07ce98bf None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:29.316357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:29.339946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216e6e0-781f-46e2-ace6-195b07ce98bf None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:29.375450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:29.376097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.376217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 133/266] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:57:29.376622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.376622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.377438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8, user.id=21aea337447742a5a1dc4e6a4c247794) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:29.378288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:29.379794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:29.382369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8a96-79b5-47a6-b1d0-d3d5d2b06bd3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:29.384573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:29.387508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 134/267] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:29 2022] GET /identity/v3/role_assignments?user.id=21aea337447742a5a1dc4e6a4c247794&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:29.502179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a8a96-79b5-47a6-b1d0-d3d5d2b06bd3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:29.540716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8def4b2-cd2e-427f-97a2-44783230427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:29.541360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8def4b2-cd2e-427f-97a2-44783230427b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.541646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8def4b2-cd2e-427f-97a2-44783230427b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.541925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8def4b2-cd2e-427f-97a2-44783230427b None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.543093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8def4b2-cd2e-427f-97a2-44783230427b None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:29.544589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8def4b2-cd2e-427f-97a2-44783230427b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:29.546429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 134/268] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:29 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:29.552422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:29.594083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a040b1-157c-487e-9153-e13692dce2a1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.594083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a040b1-157c-487e-9153-e13692dce2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.594083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a040b1-157c-487e-9153-e13692dce2a1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.594083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 135/269] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:29.611965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae33e59-68b3-41bd-aaa5-5017cec27a41 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.611965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae33e59-68b3-41bd-aaa5-5017cec27a41 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.611965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae33e59-68b3-41bd-aaa5-5017cec27a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.640958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6ae33e59-68b3-41bd-aaa5-5017cec27a41 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:29.642188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6ae33e59-68b3-41bd-aaa5-5017cec27a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:29.698353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e5fec-3e3a-4710-ada4-11a81fe1ceaa None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:29.730572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:29.737074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002409e-fb16-46b3-8f9a-eaf688b4b16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:29.738162 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002409e-fb16-46b3-8f9a-eaf688b4b16e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.738648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002409e-fb16-46b3-8f9a-eaf688b4b16e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.739124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002409e-fb16-46b3-8f9a-eaf688b4b16e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.740124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002409e-fb16-46b3-8f9a-eaf688b4b16e None admin] RBAC: Adding query filter params (role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8, user.id=21aea337447742a5a1dc4e6a4c247794) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:29.740657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002409e-fb16-46b3-8f9a-eaf688b4b16e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:29.742311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002409e-fb16-46b3-8f9a-eaf688b4b16e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:29.748891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 135/270] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:29 2022] GET /identity/v3/role_assignments?user.id=21aea337447742a5a1dc4e6a4c247794&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=d2a640c46df448be87633e4dd910c74f => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:29.770417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 136/271] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:29.776410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:29.792135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a03c-d734-4a52-b605-50cd4fbfcd7a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.792816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a03c-d734-4a52-b605-50cd4fbfcd7a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.793312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a03c-d734-4a52-b605-50cd4fbfcd7a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.795003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 136/272] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:29.802300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528b98-ece6-4e34-866f-143fb85ee136 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:29.802762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528b98-ece6-4e34-866f-143fb85ee136 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:29.803163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58528b98-ece6-4e34-866f-143fb85ee136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:29.823619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-58528b98-ece6-4e34-866f-143fb85ee136 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:29.824873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-58528b98-ece6-4e34-866f-143fb85ee136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:29.906222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 137/273] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:30.094035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2a03c-d734-4a52-b605-50cd4fbfcd7a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:30.216990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2a03c-d734-4a52-b605-50cd4fbfcd7a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:30.222462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528b98-ece6-4e34-866f-143fb85ee136 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:30.258390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfe0dc-9140-4f76-8bc8-1f54b36ba5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:30.259036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfe0dc-9140-4f76-8bc8-1f54b36ba5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.259322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfe0dc-9140-4f76-8bc8-1f54b36ba5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.259600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfe0dc-9140-4f76-8bc8-1f54b36ba5f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.261058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfe0dc-9140-4f76-8bc8-1f54b36ba5f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:30.263250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bfe0dc-9140-4f76-8bc8-1f54b36ba5f3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:30.265446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 137/274] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:30.271546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfe0dc-9140-4f76-8bc8-1f54b36ba5f3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:30.353471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58528b98-ece6-4e34-866f-143fb85ee136 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:30.355123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:30.388729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:30.395866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ad6eb-abd3-427c-9402-7c4515f90f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:30.396423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad6eb-abd3-427c-9402-7c4515f90f32 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.396707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad6eb-abd3-427c-9402-7c4515f90f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.397103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ad6eb-abd3-427c-9402-7c4515f90f32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.399462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bfe0dc-9140-4f76-8bc8-1f54b36ba5f3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:30.411690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ad6eb-abd3-427c-9402-7c4515f90f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e79ad6eb-abd3-427c-9402-7c4515f90f32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:30.417611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:30.418604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:30.419496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:30.423642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 138/275] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:30.426665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ad6eb-abd3-427c-9402-7c4515f90f32 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:30.445445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1217-ac8c-4f23-a078-5360eff5362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:30.446467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1217-ac8c-4f23-a078-5360eff5362d None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.447023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1217-ac8c-4f23-a078-5360eff5362d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.447492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1217-ac8c-4f23-a078-5360eff5362d None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.448940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd1217-ac8c-4f23-a078-5360eff5362d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:30.450572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd1217-ac8c-4f23-a078-5360eff5362d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:30.541025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ad6eb-abd3-427c-9402-7c4515f90f32 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:30.573389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 138/276] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:30 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:30.575013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a20d-a313-4e1f-b87a-950c9f7db0bf None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.575504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a20d-a313-4e1f-b87a-950c9f7db0bf None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.576013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4a20d-a313-4e1f-b87a-950c9f7db0bf None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.577494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 139/277] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:30.584056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63d93-ac83-400c-acc0-8e28fbd834cd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.584717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:30.585107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63d93-ac83-400c-acc0-8e28fbd834cd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.585352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.585638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.585921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.586209 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef63d93-ac83-400c-acc0-8e28fbd834cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.586626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:30.586936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:30.588416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:30.600323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 139/278] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:30.606253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:30.611053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6ef63d93-ac83-400c-acc0-8e28fbd834cd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:30.613388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6ef63d93-ac83-400c-acc0-8e28fbd834cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:30.667413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:30.689558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 140/279] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:30.734842 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc042-f3c7-416f-8deb-d598a7f0461f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:30.754855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afcafc-1e28-45f7-993a-a46dea116dc4 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.755396 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afcafc-1e28-45f7-993a-a46dea116dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.755396 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afcafc-1e28-45f7-993a-a46dea116dc4 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.756930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 141/280] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:30.761975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0ab24-7439-47f4-b2f5-36ac11e1b6a3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.762255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0ab24-7439-47f4-b2f5-36ac11e1b6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.762532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0ab24-7439-47f4-b2f5-36ac11e1b6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.780591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3469e4-d7b2-4159-9bb6-160ed2e41fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:30.781236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3469e4-d7b2-4159-9bb6-160ed2e41fbf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.781518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3469e4-d7b2-4159-9bb6-160ed2e41fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.781793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3469e4-d7b2-4159-9bb6-160ed2e41fbf None admin] PATH_INFO: `/v3/users/3bb580ee3e97405a9c0d18f415f2ca32` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.784616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7fd0ab24-7439-47f4-b2f5-36ac11e1b6a3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:30.786197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7fd0ab24-7439-47f4-b2f5-36ac11e1b6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:30.802190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3469e4-d7b2-4159-9bb6-160ed2e41fbf None admin] RBAC: Authorizing `identity:get_user(user_id=3bb580ee3e97405a9c0d18f415f2ca32)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:30.805518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3469e4-d7b2-4159-9bb6-160ed2e41fbf None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:30.806441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 140/281] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:30 2022] GET /identity/v3/users/3bb580ee3e97405a9c0d18f415f2ca32 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:30.811906 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3469e4-d7b2-4159-9bb6-160ed2e41fbf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:30.855806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:30.881402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 142/282] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:30.943441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3469e4-d7b2-4159-9bb6-160ed2e41fbf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:30.955563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:30.978739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0ab24-7439-47f4-b2f5-36ac11e1b6a3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:30.981836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:30.982698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:30.982917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:30.984878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:30.985916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] RBAC: Adding query filter params (role.id=cf033ca534d941b5b3284c687e715647, user.id=3bb580ee3e97405a9c0d18f415f2ca32, scope.system=all) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:30.986467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:30.989498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:30.995568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 141/283] 10.222.0.82 () {56 vars in 1308 bytes} [Mon Aug 29 18:57:30 2022] GET /identity/v3/role_assignments?user.id=3bb580ee3e97405a9c0d18f415f2ca32&scope.system=all&role.id=cf033ca534d941b5b3284c687e715647 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:31.106460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0ab24-7439-47f4-b2f5-36ac11e1b6a3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:31.157263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf0ca2-4f1d-4ee1-8025-0856cbca064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:31.157876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf0ca2-4f1d-4ee1-8025-0856cbca064a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:31.158158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf0ca2-4f1d-4ee1-8025-0856cbca064a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:31.158428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf0ca2-4f1d-4ee1-8025-0856cbca064a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:31.183986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf0ca2-4f1d-4ee1-8025-0856cbca064a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:31.184531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-cfcf0ca2-4f1d-4ee1-8025-0856cbca064a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:31.189444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:31.190481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:31.192439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:31.193414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 143/284] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:31.200320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf0ca2-4f1d-4ee1-8025-0856cbca064a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:31.271143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:31.335550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051130e-2e79-48f0-a6b3-c888dd8685b2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:31.372425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf0ca2-4f1d-4ee1-8025-0856cbca064a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:31.416035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:31.416035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:31.416855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:31.417305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:31.419160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:31.419685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:31.421302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:31.432108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 144/285] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:31.435085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fd0e8-a275-4969-a4f6-5ab591f965e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:31.436297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd0e8-a275-4969-a4f6-5ab591f965e1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:31.436836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd0e8-a275-4969-a4f6-5ab591f965e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:31.437857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:31.438682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fd0e8-a275-4969-a4f6-5ab591f965e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:31.464701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fd0e8-a275-4969-a4f6-5ab591f965e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e42fd0e8-a275-4969-a4f6-5ab591f965e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:31.470808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:31.472151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:31.473062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:31.482950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 142/286] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:31.485832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fd0e8-a275-4969-a4f6-5ab591f965e1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:31.554679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:31.637405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb325d3-1a61-44ff-be7c-6775f062aaca None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:31.641492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:31.678970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fd0e8-a275-4969-a4f6-5ab591f965e1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:31.702275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1d77-2607-40fd-9c25-f45d44dd62c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:31.702915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1d77-2607-40fd-9c25-f45d44dd62c3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:31.703194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1d77-2607-40fd-9c25-f45d44dd62c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:31.703465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1d77-2607-40fd-9c25-f45d44dd62c3 None admin] PATH_INFO: `/v3/users/d3184598982e478c9638cadd332c52e9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:31.705355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1d77-2607-40fd-9c25-f45d44dd62c3 None admin] RBAC: Authorizing `identity:get_user(user_id=d3184598982e478c9638cadd332c52e9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:31.707578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1d77-2607-40fd-9c25-f45d44dd62c3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:31.709624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 145/287] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:31 2022] GET /identity/v3/users/d3184598982e478c9638cadd332c52e9 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:31.716053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1d77-2607-40fd-9c25-f45d44dd62c3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:31.745772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:31.746380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:31.746658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:31.746929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:31.747597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:31.747924 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:31.749360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:31.764420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 143/288] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:31.770426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:31.906108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1d77-2607-40fd-9c25-f45d44dd62c3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:31.944217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:31.953391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25223f0-bd6f-4be8-92f4-3baa582117f4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:31.975563 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8d36-9a71-4a11-8f46-caac2bf2d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:31.976231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8d36-9a71-4a11-8f46-caac2bf2d576 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:31.976514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8d36-9a71-4a11-8f46-caac2bf2d576 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:31.976788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8d36-9a71-4a11-8f46-caac2bf2d576 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:31.978057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8d36-9a71-4a11-8f46-caac2bf2d576 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:31.979496 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8d36-9a71-4a11-8f46-caac2bf2d576 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:31.983314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 146/289] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:31 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:31.991074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8d36-9a71-4a11-8f46-caac2bf2d576 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:32.021043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5578cc-c4c6-4fb1-a43d-35c6acf88e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:32.021686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5578cc-c4c6-4fb1-a43d-35c6acf88e17 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:32.021966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5578cc-c4c6-4fb1-a43d-35c6acf88e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:32.022325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5578cc-c4c6-4fb1-a43d-35c6acf88e17 None admin] PATH_INFO: `/v3/users/ade72dbb807a45ab9f55f103429e58f2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:32.023674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5578cc-c4c6-4fb1-a43d-35c6acf88e17 None admin] RBAC: Authorizing `identity:get_user(user_id=ade72dbb807a45ab9f55f103429e58f2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:32.025131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5578cc-c4c6-4fb1-a43d-35c6acf88e17 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:32.027139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 144/290] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:31 2022] GET /identity/v3/users/ade72dbb807a45ab9f55f103429e58f2 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:32.033284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5578cc-c4c6-4fb1-a43d-35c6acf88e17 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:32.056084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:32.169504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8d36-9a71-4a11-8f46-caac2bf2d576 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:32.202910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5578cc-c4c6-4fb1-a43d-35c6acf88e17 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:32.246125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcca61-ee5c-423e-a811-edef24316cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:32.246748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcca61-ee5c-423e-a811-edef24316cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:32.247131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcca61-ee5c-423e-a811-edef24316cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:32.247412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcca61-ee5c-423e-a811-edef24316cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:32.252432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffe79-2949-44df-b5ba-6c02e558c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:32.254024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffe79-2949-44df-b5ba-6c02e558c74e None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:32.254533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffe79-2949-44df-b5ba-6c02e558c74e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:32.255035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ffe79-2949-44df-b5ba-6c02e558c74e None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/users/d3184598982e478c9638cadd332c52e9/roles/61ad56bfd6a646e19984b23e39b8b664` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:32.260700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ffe79-2949-44df-b5ba-6c02e558c74e None admin] RBAC: Authorizing `identity:create_grant(project_id=c080bc0c25374fe7867a8a2a06a093a8, user_id=d3184598982e478c9638cadd332c52e9, role_id=61ad56bfd6a646e19984b23e39b8b664)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:32.262302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ffe79-2949-44df-b5ba-6c02e558c74e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:32.283712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:32.324581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcca61-ee5c-423e-a811-edef24316cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:32.326313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcca61-ee5c-423e-a811-edef24316cd9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:32.350230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 147/291] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:57:31 2022] PUT /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/users/d3184598982e478c9638cadd332c52e9/roles/61ad56bfd6a646e19984b23e39b8b664 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:32.476254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 145/292] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:57:32.483644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffe79-2949-44df-b5ba-6c02e558c74e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:32.608866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:32.616063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ffe79-2949-44df-b5ba-6c02e558c74e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:32.661211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f90dd5-1470-405f-a813-bb5b48ecb55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:32.661868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f90dd5-1470-405f-a813-bb5b48ecb55e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:32.662152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f90dd5-1470-405f-a813-bb5b48ecb55e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:32.662431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f90dd5-1470-405f-a813-bb5b48ecb55e None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:32.663676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f90dd5-1470-405f-a813-bb5b48ecb55e None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:32.665183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f90dd5-1470-405f-a813-bb5b48ecb55e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:32.671865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 148/293] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:32 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:32.677127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcca61-ee5c-423e-a811-edef24316cd9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:32.770422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:32.826922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcca61-ee5c-423e-a811-edef24316cd9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:32.877764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995e372-cd24-429f-a5df-ba70db79f467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:32.878897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e372-cd24-429f-a5df-ba70db79f467 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:32.879177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e372-cd24-429f-a5df-ba70db79f467 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:32.879449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e372-cd24-429f-a5df-ba70db79f467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:32.880215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995e372-cd24-429f-a5df-ba70db79f467 None admin] RBAC: Adding query filter params (role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8, user.id=ade72dbb807a45ab9f55f103429e58f2) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:32.880523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995e372-cd24-429f-a5df-ba70db79f467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:32.881964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995e372-cd24-429f-a5df-ba70db79f467 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:32.892556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 146/294] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:32 2022] GET /identity/v3/role_assignments?user.id=ade72dbb807a45ab9f55f103429e58f2&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=cf033ca534d941b5b3284c687e715647 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:33.133958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fe281-5c14-452f-82dc-ac26d1bd1796 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.134295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fe281-5c14-452f-82dc-ac26d1bd1796 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.134470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fe281-5c14-452f-82dc-ac26d1bd1796 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.135789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 149/295] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:33.145623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0212af6-4535-401b-b046-fd4ceb988479 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.145623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0212af6-4535-401b-b046-fd4ceb988479 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.145623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0212af6-4535-401b-b046-fd4ceb988479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.168430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e0212af6-4535-401b-b046-fd4ceb988479 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:33.170003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0212af6-4535-401b-b046-fd4ceb988479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:33.262551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 147/296] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:33.321949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794455-4e93-42ce-b886-36d2ec20c43f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.322262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794455-4e93-42ce-b886-36d2ec20c43f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.322505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794455-4e93-42ce-b886-36d2ec20c43f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.323876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 150/297] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:33.329316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc47a-5146-4315-8b9d-06f39cc791fe None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.329602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc47a-5146-4315-8b9d-06f39cc791fe None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.329879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dc47a-5146-4315-8b9d-06f39cc791fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.349025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-513dc47a-5146-4315-8b9d-06f39cc791fe None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:33.350359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-513dc47a-5146-4315-8b9d-06f39cc791fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:33.414935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:33.421224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd5c3-ba42-4221-8894-5423191c4e65 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.422043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd5c3-ba42-4221-8894-5423191c4e65 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.422501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cddd5c3-ba42-4221-8894-5423191c4e65 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.424177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 151/298] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:33.430337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 148/299] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:33.431912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c57a-8fa0-42b9-b7e4-2848ddf72bfe None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.432395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c57a-8fa0-42b9-b7e4-2848ddf72bfe None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.432849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c57a-8fa0-42b9-b7e4-2848ddf72bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.452610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4c24c57a-8fa0-42b9-b7e4-2848ddf72bfe None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:33.454059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4c24c57a-8fa0-42b9-b7e4-2848ddf72bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:33.524841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 152/300] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:33.555313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc47a-5146-4315-8b9d-06f39cc791fe None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:33.671506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dc47a-5146-4315-8b9d-06f39cc791fe None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:33.707694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130145-1af9-48b6-a59e-34181011e923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:33.708521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130145-1af9-48b6-a59e-34181011e923 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.708521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130145-1af9-48b6-a59e-34181011e923 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.708877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da130145-1af9-48b6-a59e-34181011e923 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.716238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24c57a-8fa0-42b9-b7e4-2848ddf72bfe None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:33.721053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da130145-1af9-48b6-a59e-34181011e923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-da130145-1af9-48b6-a59e-34181011e923 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:33.727336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:33.728313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:33.729114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:33.729709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 149/301] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:33.735332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130145-1af9-48b6-a59e-34181011e923 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:33.811761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:33.825492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:33.832832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24c57a-8fa0-42b9-b7e4-2848ddf72bfe None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:33.873230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c962a-0721-40f9-a5d3-b162c6dcc1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:33.873866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c962a-0721-40f9-a5d3-b162c6dcc1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.874266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c962a-0721-40f9-a5d3-b162c6dcc1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.874542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c962a-0721-40f9-a5d3-b162c6dcc1d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.875816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c962a-0721-40f9-a5d3-b162c6dcc1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:33.877239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c962a-0721-40f9-a5d3-b162c6dcc1d6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:33.877656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da130145-1af9-48b6-a59e-34181011e923 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:33.885233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 153/302] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:33.885233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c962a-0721-40f9-a5d3-b162c6dcc1d6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:33.915592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:33.916346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:33.916639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:33.916914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:33.917608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:33.917921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:33.919300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:33.935240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 150/303] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:33.935240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:34.002701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c962a-0721-40f9-a5d3-b162c6dcc1d6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:34.038085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4700e3-e561-411c-b542-e2c4d86aa60e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:34.039702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faee26-1cc9-497e-87d5-f776a6e7ffd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:34.040484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faee26-1cc9-497e-87d5-f776a6e7ffd7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.040769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faee26-1cc9-497e-87d5-f776a6e7ffd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.041040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faee26-1cc9-497e-87d5-f776a6e7ffd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.048768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:34.052919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faee26-1cc9-497e-87d5-f776a6e7ffd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-53faee26-1cc9-497e-87d5-f776a6e7ffd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:34.057806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:34.073615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 154/304] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:34.074502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faee26-1cc9-497e-87d5-f776a6e7ffd7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:34.077206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67d67-f4c5-4a36-a3ea-4483e3fd57c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:34.077883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67d67-f4c5-4a36-a3ea-4483e3fd57c8 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.078167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67d67-f4c5-4a36-a3ea-4483e3fd57c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.078447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67d67-f4c5-4a36-a3ea-4483e3fd57c8 None admin] PATH_INFO: `/v3/groups` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.079099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a67d67-f4c5-4a36-a3ea-4483e3fd57c8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:34.080561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a67d67-f4c5-4a36-a3ea-4483e3fd57c8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:34.090586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:34.159788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 151/305] 10.222.0.82 () {60 vars in 1134 bytes} [Mon Aug 29 18:57:33 2022] POST /identity/v3/groups => generated 229 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:34.159788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67d67-f4c5-4a36-a3ea-4483e3fd57c8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:34.172894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faee26-1cc9-497e-87d5-f776a6e7ffd7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:34.215668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596a6f-2785-4ab2-928b-8b51433e729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:34.216640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596a6f-2785-4ab2-928b-8b51433e729f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.216927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596a6f-2785-4ab2-928b-8b51433e729f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.217205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596a6f-2785-4ab2-928b-8b51433e729f None admin] PATH_INFO: `/v3/users/66a22496a1f94b64a0fecf319d37fad9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.235035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8596a6f-2785-4ab2-928b-8b51433e729f None admin] RBAC: Authorizing `identity:get_user(user_id=66a22496a1f94b64a0fecf319d37fad9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:34.236547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8596a6f-2785-4ab2-928b-8b51433e729f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:34.239183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 155/306] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:34 2022] GET /identity/v3/users/66a22496a1f94b64a0fecf319d37fad9 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:34.245252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596a6f-2785-4ab2-928b-8b51433e729f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:34.311802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67d67-f4c5-4a36-a3ea-4483e3fd57c8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:34.349619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:34.355863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:34.356691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.357136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.357574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.358405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:34.360689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:34.360689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:34.372137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 152/307] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:34.373639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596a6f-2785-4ab2-928b-8b51433e729f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:34.379068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:34.420536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:34.421179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.421458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.421969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.422516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] RBAC: Adding query filter params (role.id=61ad56bfd6a646e19984b23e39b8b664, user.id=66a22496a1f94b64a0fecf319d37fad9, scope.system=all) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:34.422863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:34.425114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:34.430995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 156/308] 10.222.0.82 () {56 vars in 1308 bytes} [Mon Aug 29 18:57:34 2022] GET /identity/v3/role_assignments?user.id=66a22496a1f94b64a0fecf319d37fad9&scope.system=all&role.id=61ad56bfd6a646e19984b23e39b8b664 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:34.431265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:34.517999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e9a9a-69e6-4e0b-b743-4d961e778c5c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:34.559879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39dd00a-b487-403c-97e4-6b21d3c948c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:34.561385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd00a-b487-403c-97e4-6b21d3c948c4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.561873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd00a-b487-403c-97e4-6b21d3c948c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.562350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39dd00a-b487-403c-97e4-6b21d3c948c4 None admin] PATH_INFO: `/v3/users/3bb580ee3e97405a9c0d18f415f2ca32` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.563838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dd00a-b487-403c-97e4-6b21d3c948c4 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb580ee3e97405a9c0d18f415f2ca32)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:34.565674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39dd00a-b487-403c-97e4-6b21d3c948c4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:34.568314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 153/309] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:34 2022] GET /identity/v3/users/3bb580ee3e97405a9c0d18f415f2ca32 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:34.574931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:34.691561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067f2f5-7642-4703-bca1-f51031b5c150 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:34.718392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4599b1-432f-4dca-8921-f72a33f209ff None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.718723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4599b1-432f-4dca-8921-f72a33f209ff None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.718954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4599b1-432f-4dca-8921-f72a33f209ff None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.720581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 154/310] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:34.726812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7517b-0b26-41be-a664-41ca8e8058a4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.727108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7517b-0b26-41be-a664-41ca8e8058a4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.727387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7517b-0b26-41be-a664-41ca8e8058a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.729624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53f8b5-76a4-4b6b-abd4-85e38eddb6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:34.730618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f8b5-76a4-4b6b-abd4-85e38eddb6d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:34.731106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f8b5-76a4-4b6b-abd4-85e38eddb6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:34.731596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53f8b5-76a4-4b6b-abd4-85e38eddb6d1 None admin] PATH_INFO: `/v3/system/users/3bb580ee3e97405a9c0d18f415f2ca32/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:34.733290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53f8b5-76a4-4b6b-abd4-85e38eddb6d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3bb580ee3e97405a9c0d18f415f2ca32, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:34.736204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53f8b5-76a4-4b6b-abd4-85e38eddb6d1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:34.747086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3af7517b-0b26-41be-a664-41ca8e8058a4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:34.748876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3af7517b-0b26-41be-a664-41ca8e8058a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:34.824895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 155/311] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:34.830450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 157/312] 10.222.0.82 () {58 vars in 1334 bytes} [Mon Aug 29 18:57:34 2022] PUT /identity/v3/system/users/3bb580ee3e97405a9c0d18f415f2ca32/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:35.104149 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7517b-0b26-41be-a664-41ca8e8058a4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:35.135288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:35.209268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7517b-0b26-41be-a664-41ca8e8058a4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:35.245099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0515ff-7e89-4c6e-8151-a6f021a22477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:35.245740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0515ff-7e89-4c6e-8151-a6f021a22477 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:35.246023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0515ff-7e89-4c6e-8151-a6f021a22477 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:35.246299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0515ff-7e89-4c6e-8151-a6f021a22477 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:35.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0515ff-7e89-4c6e-8151-a6f021a22477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2f0515ff-7e89-4c6e-8151-a6f021a22477 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:35.264868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:35.265740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:35.266533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 156/313] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:35.272345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53f8b5-76a4-4b6b-abd4-85e38eddb6d1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:35.284356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:35.381002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53f8b5-76a4-4b6b-abd4-85e38eddb6d1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:35.420431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:35.421063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:35.421399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:35.421685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:35.422372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:35.422913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:35.424366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:35.434667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 158/314] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:35.440799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0515ff-7e89-4c6e-8151-a6f021a22477 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:35.539259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:35.549138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0515ff-7e89-4c6e-8151-a6f021a22477 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:35.590028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf926140-481b-4d25-92db-b12ab89de793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:35.590650 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926140-481b-4d25-92db-b12ab89de793 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:35.590931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926140-481b-4d25-92db-b12ab89de793 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:35.591207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf926140-481b-4d25-92db-b12ab89de793 None admin] PATH_INFO: `/v3/users/d3184598982e478c9638cadd332c52e9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:35.592351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf926140-481b-4d25-92db-b12ab89de793 None admin] RBAC: Authorizing `identity:get_user(user_id=d3184598982e478c9638cadd332c52e9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:35.593871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf926140-481b-4d25-92db-b12ab89de793 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:35.595814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 157/315] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:35 2022] GET /identity/v3/users/d3184598982e478c9638cadd332c52e9 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:35.601683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:35.679548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:35.713010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf62f2-113a-40f5-9fce-ac01e969428f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:35.756425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce0ac-6536-4fbb-aa0d-7a54ea2dbf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:35.757042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce0ac-6536-4fbb-aa0d-7a54ea2dbf26 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:35.757330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce0ac-6536-4fbb-aa0d-7a54ea2dbf26 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:35.757605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dce0ac-6536-4fbb-aa0d-7a54ea2dbf26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:35.829183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dce0ac-6536-4fbb-aa0d-7a54ea2dbf26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:35.831347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dce0ac-6536-4fbb-aa0d-7a54ea2dbf26 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:35.903546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:35.937463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 159/316] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:35.944058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf926140-481b-4d25-92db-b12ab89de793 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:36.060487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf926140-481b-4d25-92db-b12ab89de793 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:36.096194 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12d016-ac47-4c50-8112-695409245d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:36.097467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d016-ac47-4c50-8112-695409245d4d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:36.097752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d016-ac47-4c50-8112-695409245d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:36.098021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12d016-ac47-4c50-8112-695409245d4d None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:36.099152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12d016-ac47-4c50-8112-695409245d4d None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:36.100612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12d016-ac47-4c50-8112-695409245d4d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:36.102580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 158/317] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:35 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:36.108124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce0ac-6536-4fbb-aa0d-7a54ea2dbf26 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:36.218257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dce0ac-6536-4fbb-aa0d-7a54ea2dbf26 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:36.255333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ffaeb-b72e-4062-9518-1adc4acd77dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:36.255972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ffaeb-b72e-4062-9518-1adc4acd77dc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:36.256259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ffaeb-b72e-4062-9518-1adc4acd77dc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:36.256536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ffaeb-b72e-4062-9518-1adc4acd77dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:36.257279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ffaeb-b72e-4062-9518-1adc4acd77dc None admin] RBAC: Adding query filter params (role.id=61ad56bfd6a646e19984b23e39b8b664, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8, user.id=d3184598982e478c9638cadd332c52e9) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:36.257593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ffaeb-b72e-4062-9518-1adc4acd77dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:36.259114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ffaeb-b72e-4062-9518-1adc4acd77dc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:36.265749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 160/318] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:57:36 2022] GET /identity/v3/role_assignments?user.id=d3184598982e478c9638cadd332c52e9&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=61ad56bfd6a646e19984b23e39b8b664 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:36.317903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0be22-6dc1-47dc-8f28-d0fb8e8f06d2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:36.318210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0be22-6dc1-47dc-8f28-d0fb8e8f06d2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:36.318632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0be22-6dc1-47dc-8f28-d0fb8e8f06d2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:36.320814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 159/319] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:36.327183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b8b2-0fe1-45c8-a49b-9259ff966883 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:36.327555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b8b2-0fe1-45c8-a49b-9259ff966883 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:36.327959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b8b2-0fe1-45c8-a49b-9259ff966883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:36.348791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5cc0b8b2-0fe1-45c8-a49b-9259ff966883 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:36.350035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5cc0b8b2-0fe1-45c8-a49b-9259ff966883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:36.382005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:36.428539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 161/320] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:36.500772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4ed6-a71d-4258-9e50-bceb4e4f571c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:36.501099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4ed6-a71d-4258-9e50-bceb4e4f571c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:36.501528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de4ed6-a71d-4258-9e50-bceb4e4f571c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:36.504739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 160/321] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:36.510423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1c70-61d0-482b-b19a-96ad26cf0e9e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:36.510952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1c70-61d0-482b-b19a-96ad26cf0e9e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:36.511236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd1c70-61d0-482b-b19a-96ad26cf0e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:36.530950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6dcd1c70-61d0-482b-b19a-96ad26cf0e9e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:36.532168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6dcd1c70-61d0-482b-b19a-96ad26cf0e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:36.603193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 162/322] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:36.705755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de4ed6-a71d-4258-9e50-bceb4e4f571c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:36.735634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:36.813251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de4ed6-a71d-4258-9e50-bceb4e4f571c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:36.848036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615537-d05b-4a88-a4cf-89bee33f5f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:36.848677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615537-d05b-4a88-a4cf-89bee33f5f66 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:36.849031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615537-d05b-4a88-a4cf-89bee33f5f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:36.849299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44615537-d05b-4a88-a4cf-89bee33f5f66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:36.850456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615537-d05b-4a88-a4cf-89bee33f5f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:36.851933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44615537-d05b-4a88-a4cf-89bee33f5f66 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:36.853736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 161/323] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:36.859018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1c70-61d0-482b-b19a-96ad26cf0e9e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:36.883464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615537-d05b-4a88-a4cf-89bee33f5f66 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:36.961924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:36.969564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd1c70-61d0-482b-b19a-96ad26cf0e9e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:36.980125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:36.986600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44615537-d05b-4a88-a4cf-89bee33f5f66 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:37.003811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591ee7d-6d0b-4cf8-b535-6c2dadfa0f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:37.004433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591ee7d-6d0b-4cf8-b535-6c2dadfa0f9a None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.004716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591ee7d-6d0b-4cf8-b535-6c2dadfa0f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.004991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591ee7d-6d0b-4cf8-b535-6c2dadfa0f9a None admin] PATH_INFO: `/v3/groups` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.005630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591ee7d-6d0b-4cf8-b535-6c2dadfa0f9a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:37.007071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591ee7d-6d0b-4cf8-b535-6c2dadfa0f9a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:37.021483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef10f2-2d4f-40a9-b02c-e19c136ad9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:37.022104 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef10f2-2d4f-40a9-b02c-e19c136ad9fe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.022384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef10f2-2d4f-40a9-b02c-e19c136ad9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.022656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef10f2-2d4f-40a9-b02c-e19c136ad9fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.032555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edef10f2-2d4f-40a9-b02c-e19c136ad9fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-edef10f2-2d4f-40a9-b02c-e19c136ad9fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:37.037456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:37.038517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:37.039320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 162/324] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:37.040006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556abd-a224-48e1-9119-646eef7eeeb2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.040072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556abd-a224-48e1-9119-646eef7eeeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.040337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556abd-a224-48e1-9119-646eef7eeeb2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.041633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 163/325] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:37.044822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556abd-a224-48e1-9119-646eef7eeeb2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:37.099868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 163/326] 10.222.0.82 () {60 vars in 1134 bytes} [Mon Aug 29 18:57:36 2022] POST /identity/v3/groups => generated 226 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:57:37.099868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128c45-33a9-4a7d-80e5-18965c7a3887 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.099868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128c45-33a9-4a7d-80e5-18965c7a3887 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.099868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f128c45-33a9-4a7d-80e5-18965c7a3887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.112727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3f128c45-33a9-4a7d-80e5-18965c7a3887 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:37.114015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3f128c45-33a9-4a7d-80e5-18965c7a3887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:37.156850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556abd-a224-48e1-9119-646eef7eeeb2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:37.196270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 164/327] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:37.199961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:37.199961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.199961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.200174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.200746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:37.201061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:37.202453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:37.215511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 164/328] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:37.220985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128c45-33a9-4a7d-80e5-18965c7a3887 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:37.315873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:37.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f128c45-33a9-4a7d-80e5-18965c7a3887 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:37.373637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48e42b-0847-4012-8fd7-b0e0f07e3598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:37.374220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e42b-0847-4012-8fd7-b0e0f07e3598 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.374543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e42b-0847-4012-8fd7-b0e0f07e3598 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.374776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e42b-0847-4012-8fd7-b0e0f07e3598 None admin] PATH_INFO: `/v3/users/66a22496a1f94b64a0fecf319d37fad9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.375971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48e42b-0847-4012-8fd7-b0e0f07e3598 None admin] RBAC: Authorizing `identity:get_user(user_id=66a22496a1f94b64a0fecf319d37fad9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:37.377404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48e42b-0847-4012-8fd7-b0e0f07e3598 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:37.379981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 165/329] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:37 2022] GET /identity/v3/users/66a22496a1f94b64a0fecf319d37fad9 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:37.385448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:37.411153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:37.468397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48e42b-0847-4012-8fd7-b0e0f07e3598 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:37.519282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b9a7d-b2e1-4ea2-956c-5d5a5e9fb300 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:37.558601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03efcda-4478-4364-a795-252ab48424f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:37.559261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03efcda-4478-4364-a795-252ab48424f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.559544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03efcda-4478-4364-a795-252ab48424f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.559854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03efcda-4478-4364-a795-252ab48424f7 None admin] PATH_INFO: `/v3/system/users/66a22496a1f94b64a0fecf319d37fad9/roles/61ad56bfd6a646e19984b23e39b8b664` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.561365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03efcda-4478-4364-a795-252ab48424f7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66a22496a1f94b64a0fecf319d37fad9, role_id=61ad56bfd6a646e19984b23e39b8b664)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:37.562747 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03efcda-4478-4364-a795-252ab48424f7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:37.599441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48e42b-0847-4012-8fd7-b0e0f07e3598 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:37.642384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 165/330] 10.222.0.82 () {58 vars in 1334 bytes} [Mon Aug 29 18:57:37 2022] PUT /identity/v3/system/users/66a22496a1f94b64a0fecf319d37fad9/roles/61ad56bfd6a646e19984b23e39b8b664 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:37.645104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8340c3-6807-4691-9208-32f594134b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:37.645760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8340c3-6807-4691-9208-32f594134b15 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.646111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8340c3-6807-4691-9208-32f594134b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.646389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8340c3-6807-4691-9208-32f594134b15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.659518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8340c3-6807-4691-9208-32f594134b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6d8340c3-6807-4691-9208-32f594134b15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:37.665544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:37.666485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:37.667289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 166/331] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:37.674768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03efcda-4478-4364-a795-252ab48424f7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:37.780001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:37.803386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03efcda-4478-4364-a795-252ab48424f7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:37.841228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:37.841853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:37.842129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:37.842418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:37.843153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:37.843454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:37.844868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:37.855246 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 166/332] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:37.861357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8340c3-6807-4691-9208-32f594134b15 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:37.883208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:37.983953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8340c3-6807-4691-9208-32f594134b15 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:38.023633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b56d0b-b7b5-4263-bade-56b82d0c1753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:38.024300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56d0b-b7b5-4263-bade-56b82d0c1753 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:38.024579 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56d0b-b7b5-4263-bade-56b82d0c1753 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:38.024850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56d0b-b7b5-4263-bade-56b82d0c1753 None admin] PATH_INFO: `/v3/users/3bb580ee3e97405a9c0d18f415f2ca32` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:38.028414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56d0b-b7b5-4263-bade-56b82d0c1753 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb580ee3e97405a9c0d18f415f2ca32)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:38.029977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b56d0b-b7b5-4263-bade-56b82d0c1753 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:38.031606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 167/333] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:37 2022] GET /identity/v3/users/3bb580ee3e97405a9c0d18f415f2ca32 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:38.038698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:38.164241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc86e2-2b00-427a-b2f1-315280a19139 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:38.209177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484de8d-8ba7-4ebb-8af8-e8b93b799d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:38.209797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484de8d-8ba7-4ebb-8af8-e8b93b799d63 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:38.210085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484de8d-8ba7-4ebb-8af8-e8b93b799d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:38.210363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484de8d-8ba7-4ebb-8af8-e8b93b799d63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:38.211101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484de8d-8ba7-4ebb-8af8-e8b93b799d63 None admin] RBAC: Adding query filter params (role.id=cf033ca534d941b5b3284c687e715647, user.id=3bb580ee3e97405a9c0d18f415f2ca32, scope.system=all) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:38.211415 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484de8d-8ba7-4ebb-8af8-e8b93b799d63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:38.212933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484de8d-8ba7-4ebb-8af8-e8b93b799d63 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:38.223338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:38.228244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 167/334] 10.222.0.82 () {56 vars in 1308 bytes} [Mon Aug 29 18:57:38 2022] GET /identity/v3/role_assignments?user.id=3bb580ee3e97405a9c0d18f415f2ca32&scope.system=all&role.id=cf033ca534d941b5b3284c687e715647 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:39.364294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4493e-a5a3-4787-9fc5-97439f7e4210 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:39.364794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4493e-a5a3-4787-9fc5-97439f7e4210 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:39.365055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4493e-a5a3-4787-9fc5-97439f7e4210 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:39.366337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 168/335] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:39.372643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2c43-21ce-46b5-9091-c45e667980d4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:39.373068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2c43-21ce-46b5-9091-c45e667980d4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:39.373248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef2c43-21ce-46b5-9091-c45e667980d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:39.400117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-47ef2c43-21ce-46b5-9091-c45e667980d4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:39.401309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-47ef2c43-21ce-46b5-9091-c45e667980d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:39.483539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 168/336] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:39.681188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0577-698b-44fa-86e0-2d4917c9513a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:39.681565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0577-698b-44fa-86e0-2d4917c9513a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:39.681742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0577-698b-44fa-86e0-2d4917c9513a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:39.683350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 169/337] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:39.688261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd18cd-2a1d-47bb-a052-fc277029a028 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:39.688545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd18cd-2a1d-47bb-a052-fc277029a028 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:39.688817 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd18cd-2a1d-47bb-a052-fc277029a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:39.712850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-38fd18cd-2a1d-47bb-a052-fc277029a028 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:39.714145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-38fd18cd-2a1d-47bb-a052-fc277029a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:39.796637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 169/338] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:39.951577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc0577-698b-44fa-86e0-2d4917c9513a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:40.060031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:40.085337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc0577-698b-44fa-86e0-2d4917c9513a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:40.127080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03176cc-e6b2-451c-acd1-e501ba047db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:40.127912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03176cc-e6b2-451c-acd1-e501ba047db6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.128288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03176cc-e6b2-451c-acd1-e501ba047db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.128570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03176cc-e6b2-451c-acd1-e501ba047db6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.145742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03176cc-e6b2-451c-acd1-e501ba047db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a03176cc-e6b2-451c-acd1-e501ba047db6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:40.150761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:40.153070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:40.154971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 170/339] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:40.159974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd18cd-2a1d-47bb-a052-fc277029a028 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:40.268854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03176cc-e6b2-451c-acd1-e501ba047db6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:40.274194 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:40.338117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd18cd-2a1d-47bb-a052-fc277029a028 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:40.423598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03176cc-e6b2-451c-acd1-e501ba047db6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:40.432014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2d917-348d-46e3-870a-db2aeec840e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:40.432646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d917-348d-46e3-870a-db2aeec840e3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.432934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d917-348d-46e3-870a-db2aeec840e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.433272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2d917-348d-46e3-870a-db2aeec840e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.433958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2d917-348d-46e3-870a-db2aeec840e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:40.434313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2d917-348d-46e3-870a-db2aeec840e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:40.435738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2d917-348d-46e3-870a-db2aeec840e3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:40.454622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 170/340] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:40.468478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e517e3-7759-49ea-b505-da54d5140e60 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.468898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e517e3-7759-49ea-b505-da54d5140e60 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.469195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e517e3-7759-49ea-b505-da54d5140e60 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.470714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 171/341] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:40.476774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e517e3-7759-49ea-b505-da54d5140e60 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:40.480392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf934a-aee5-4151-a226-809535ccf5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:40.481033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf934a-aee5-4151-a226-809535ccf5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.481308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf934a-aee5-4151-a226-809535ccf5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.481578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf934a-aee5-4151-a226-809535ccf5b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.501990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:40.505850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf934a-aee5-4151-a226-809535ccf5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f1cf934a-aee5-4151-a226-809535ccf5b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:40.511674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:40.517497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 171/342] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:40.520156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f53998-6442-412f-8aa3-0f7228cdb1bd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.522975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f53998-6442-412f-8aa3-0f7228cdb1bd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.522975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f53998-6442-412f-8aa3-0f7228cdb1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.544483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e4f53998-6442-412f-8aa3-0f7228cdb1bd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:40.546019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e4f53998-6442-412f-8aa3-0f7228cdb1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:40.645909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 172/343] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:40.647556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fdb3f-d547-4653-832b-e6946b2941b6 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.648091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fdb3f-d547-4653-832b-e6946b2941b6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.648418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e517e3-7759-49ea-b505-da54d5140e60 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:40.648779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fdb3f-d547-4653-832b-e6946b2941b6 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.651887 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 173/344] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:40.652867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fdb3f-d547-4653-832b-e6946b2941b6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:40.680582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:40.697376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200d7f-d5cd-4398-98b3-39effa960f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:40.698056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200d7f-d5cd-4398-98b3-39effa960f33 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.698335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200d7f-d5cd-4398-98b3-39effa960f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.698608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200d7f-d5cd-4398-98b3-39effa960f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.790285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b200d7f-d5cd-4398-98b3-39effa960f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:40.792166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b200d7f-d5cd-4398-98b3-39effa960f33 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:40.802644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fdb3f-d547-4653-832b-e6946b2941b6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:40.843667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:40.856532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d21970-4707-4a90-8572-1a5790ae8277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:40.858414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21970-4707-4a90-8572-1a5790ae8277 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.859058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21970-4707-4a90-8572-1a5790ae8277 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.860640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d21970-4707-4a90-8572-1a5790ae8277 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.861505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d21970-4707-4a90-8572-1a5790ae8277 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:40.862885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d21970-4707-4a90-8572-1a5790ae8277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:40.865102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d21970-4707-4a90-8572-1a5790ae8277 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:40.876206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 174/345] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:40.881379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088f17-ef44-467c-8f69-ce713cdb1e0a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:40.882419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088f17-ef44-467c-8f69-ce713cdb1e0a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:40.884007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5088f17-ef44-467c-8f69-ce713cdb1e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:40.911429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e5088f17-ef44-467c-8f69-ce713cdb1e0a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:40.912582 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e5088f17-ef44-467c-8f69-ce713cdb1e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:40.939622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 172/346] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:40.940696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200d7f-d5cd-4398-98b3-39effa960f33 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:40.984073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:41.036116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 175/347] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:41.036977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088f17-ef44-467c-8f69-ce713cdb1e0a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:41.124922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200d7f-d5cd-4398-98b3-39effa960f33 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:41.205135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba596-c0dd-4ee4-85bd-7ac5bd88407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:41.211839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba596-c0dd-4ee4-85bd-7ac5bd88407d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:41.211839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba596-c0dd-4ee4-85bd-7ac5bd88407d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:41.211839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba596-c0dd-4ee4-85bd-7ac5bd88407d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:41.238275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5088f17-ef44-467c-8f69-ce713cdb1e0a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:41.281036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:41.304358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d6440-9b74-4bad-89a6-08904f2e042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:41.305007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d6440-9b74-4bad-89a6-08904f2e042d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:41.305291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d6440-9b74-4bad-89a6-08904f2e042d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:41.305569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d6440-9b74-4bad-89a6-08904f2e042d None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:41.307369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d6440-9b74-4bad-89a6-08904f2e042d None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:41.308840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d6440-9b74-4bad-89a6-08904f2e042d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:41.310649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 176/348] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:41 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:41.311242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d6440-9b74-4bad-89a6-08904f2e042d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:41.337965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cba596-c0dd-4ee4-85bd-7ac5bd88407d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:41.339538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cba596-c0dd-4ee4-85bd-7ac5bd88407d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:41.380098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:41.471909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 173/349] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:41.472763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba596-c0dd-4ee4-85bd-7ac5bd88407d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:41.485645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d6440-9b74-4bad-89a6-08904f2e042d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:41.544777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e37a2-ea43-446b-939d-b8e9dc276867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:41.545598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e37a2-ea43-446b-939d-b8e9dc276867 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:41.546010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e37a2-ea43-446b-939d-b8e9dc276867 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:41.546298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e37a2-ea43-446b-939d-b8e9dc276867 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:41.561010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e37a2-ea43-446b-939d-b8e9dc276867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ff1e37a2-ea43-446b-939d-b8e9dc276867 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:41.567760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:41.568842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:41.570207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 177/350] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:41.571028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e37a2-ea43-446b-939d-b8e9dc276867 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:41.604856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cba596-c0dd-4ee4-85bd-7ac5bd88407d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:41.635529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:41.636130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:41.647473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31aaab-28ad-4994-b181-21b619abd465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:41.651703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31aaab-28ad-4994-b181-21b619abd465 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:41.651703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31aaab-28ad-4994-b181-21b619abd465 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:41.651703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31aaab-28ad-4994-b181-21b619abd465 None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:41.655314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31aaab-28ad-4994-b181-21b619abd465 None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:41.658423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31aaab-28ad-4994-b181-21b619abd465 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:41.661145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 174/351] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:41 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:41.662075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31aaab-28ad-4994-b181-21b619abd465 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:41.700528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e37a2-ea43-446b-939d-b8e9dc276867 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:41.742252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dad9e6-a96d-4a53-bf6c-546716ac3c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:41.742818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dad9e6-a96d-4a53-bf6c-546716ac3c06 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:41.743119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dad9e6-a96d-4a53-bf6c-546716ac3c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:41.743376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dad9e6-a96d-4a53-bf6c-546716ac3c06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:41.754049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dad9e6-a96d-4a53-bf6c-546716ac3c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-b9dad9e6-a96d-4a53-bf6c-546716ac3c06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:41.759462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:41.760679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:41.761804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 178/352] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:41.762464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dad9e6-a96d-4a53-bf6c-546716ac3c06 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:41.810162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31aaab-28ad-4994-b181-21b619abd465 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:41.847029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27359874-53f6-4b31-90ef-c0447b84780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:41.848098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359874-53f6-4b31-90ef-c0447b84780a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:41.848581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359874-53f6-4b31-90ef-c0447b84780a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:41.849049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27359874-53f6-4b31-90ef-c0447b84780a None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:41.850447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27359874-53f6-4b31-90ef-c0447b84780a None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:41.852221 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27359874-53f6-4b31-90ef-c0447b84780a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:41.854443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 175/353] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:41 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:41.855540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27359874-53f6-4b31-90ef-c0447b84780a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:41.878043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dad9e6-a96d-4a53-bf6c-546716ac3c06 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:41.889005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:41.918896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:41.919867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:41.920157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:41.920438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:41.921182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:41.921488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:41.922871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:41.926321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:41.937140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 179/354] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:41.938410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:41.990043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27359874-53f6-4b31-90ef-c0447b84780a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:42.033388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:42.034513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.034861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.035161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.036064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] RBAC: Adding query filter params (group.id=db8b89fb7e2d4d8182c1a23584945623, role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=370870b74de0407a9d8619b669b6f45f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:42.036272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:42.037833 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:42.045374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 176/355] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:41 2022] GET /identity/v3/role_assignments?group.id=db8b89fb7e2d4d8182c1a23584945623&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=cf033ca534d941b5b3284c687e715647 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:42.046275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:42.072293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea744a0-56bf-4ce0-a3ee-120e6543110d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:42.127148 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c26f-427a-4260-8bb9-f638269d00e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:42.129048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c26f-427a-4260-8bb9-f638269d00e5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.129336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c26f-427a-4260-8bb9-f638269d00e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.129611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c26f-427a-4260-8bb9-f638269d00e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.130307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0c26f-427a-4260-8bb9-f638269d00e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:42.130615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0c26f-427a-4260-8bb9-f638269d00e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:42.132136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0c26f-427a-4260-8bb9-f638269d00e5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:42.142545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 180/356] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:42.145955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa798-6852-4411-9bd4-b617d7143c92 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.147234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa798-6852-4411-9bd4-b617d7143c92 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.147708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa798-6852-4411-9bd4-b617d7143c92 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.149629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 181/357] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:42.152083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa798-6852-4411-9bd4-b617d7143c92 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:42.193621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:42.203380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558fdb3-60a5-4e8e-9421-fb161acc8786 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:42.232705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:42.251868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65573e91-1432-441e-9238-c2674e6c1be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:42.253374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65573e91-1432-441e-9238-c2674e6c1be4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.253831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65573e91-1432-441e-9238-c2674e6c1be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.254275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65573e91-1432-441e-9238-c2674e6c1be4 None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.255594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65573e91-1432-441e-9238-c2674e6c1be4 None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:42.257845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65573e91-1432-441e-9238-c2674e6c1be4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:42.259685 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 177/358] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:42 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:42.260998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01910ba-d8ea-4968-a6f7-08a34e3cd60c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.261280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01910ba-d8ea-4968-a6f7-08a34e3cd60c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.261554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01910ba-d8ea-4968-a6f7-08a34e3cd60c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.262884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 178/359] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:42.263637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01910ba-d8ea-4968-a6f7-08a34e3cd60c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:42.286171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa798-6852-4411-9bd4-b617d7143c92 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:42.331899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301921f-9c02-4ad2-a29d-a03d50a4b096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:42.332518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301921f-9c02-4ad2-a29d-a03d50a4b096 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.332799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301921f-9c02-4ad2-a29d-a03d50a4b096 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.333071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301921f-9c02-4ad2-a29d-a03d50a4b096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.407426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01910ba-d8ea-4968-a6f7-08a34e3cd60c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:42.417337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301921f-9c02-4ad2-a29d-a03d50a4b096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:42.418823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301921f-9c02-4ad2-a29d-a03d50a4b096 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:42.454707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96156218-400a-4f38-be1e-72b3faa6e96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:42.455979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96156218-400a-4f38-be1e-72b3faa6e96b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.456272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96156218-400a-4f38-be1e-72b3faa6e96b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.456541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96156218-400a-4f38-be1e-72b3faa6e96b None admin] PATH_INFO: `/v3/users/66a22496a1f94b64a0fecf319d37fad9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.457920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96156218-400a-4f38-be1e-72b3faa6e96b None admin] RBAC: Authorizing `identity:get_user(user_id=66a22496a1f94b64a0fecf319d37fad9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:42.459101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96156218-400a-4f38-be1e-72b3faa6e96b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:42.460716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 179/360] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:57:42 2022] GET /identity/v3/users/66a22496a1f94b64a0fecf319d37fad9 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:42.461865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44edb2-4b98-4c51-b3ca-c0d2a6317e1e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.462256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44edb2-4b98-4c51-b3ca-c0d2a6317e1e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.462631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44edb2-4b98-4c51-b3ca-c0d2a6317e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.465845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:42.482933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2d44edb2-4b98-4c51-b3ca-c0d2a6317e1e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:42.484985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2d44edb2-4b98-4c51-b3ca-c0d2a6317e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:42.557163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 182/361] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:42.557163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4b8df-b0b1-4b40-8162-e142bff411b5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.557163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4b8df-b0b1-4b40-8162-e142bff411b5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.557163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4b8df-b0b1-4b40-8162-e142bff411b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.557873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:42.577780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-efa4b8df-b0b1-4b40-8162-e142bff411b5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:42.579090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 180/362] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:42.579201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-efa4b8df-b0b1-4b40-8162-e142bff411b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:42.579846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44edb2-4b98-4c51-b3ca-c0d2a6317e1e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:42.664601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 183/363] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:42.665463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4b8df-b0b1-4b40-8162-e142bff411b5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:42.703060 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44edb2-4b98-4c51-b3ca-c0d2a6317e1e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:42.732969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:42.743187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:42.743825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.744188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.744469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.745431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] RBAC: Adding query filter params (group.id=db8b89fb7e2d4d8182c1a23584945623, role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=370870b74de0407a9d8619b669b6f45f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:42.745784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:42.747300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:42.755132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 181/364] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:42 2022] GET /identity/v3/role_assignments?group.id=db8b89fb7e2d4d8182c1a23584945623&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=d2a640c46df448be87633e4dd910c74f => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:42.756005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:42.819007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:42.822643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4b8df-b0b1-4b40-8162-e142bff411b5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:42.880776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80a9a5-c9b0-4026-a461-e4cee846a7b7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:42.913891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:42.914522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.914804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.915083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.915848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] RBAC: Adding query filter params (role.id=61ad56bfd6a646e19984b23e39b8b664, user.id=66a22496a1f94b64a0fecf319d37fad9, scope.system=all) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:42.916166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:42.917614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:42.925973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56699538-980b-47f9-837e-89fa397341a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:42.926704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56699538-980b-47f9-837e-89fa397341a6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:42.926962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56699538-980b-47f9-837e-89fa397341a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:42.927234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56699538-980b-47f9-837e-89fa397341a6 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:42.928763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56699538-980b-47f9-837e-89fa397341a6 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:42.931208 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56699538-980b-47f9-837e-89fa397341a6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:42.935700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 182/365] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:42 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:42.946448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 184/366] 10.222.0.82 () {56 vars in 1308 bytes} [Mon Aug 29 18:57:42 2022] GET /identity/v3/role_assignments?user.id=66a22496a1f94b64a0fecf319d37fad9&scope.system=all&role.id=61ad56bfd6a646e19984b23e39b8b664 => generated 510 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:42.953549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56699538-980b-47f9-837e-89fa397341a6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:43.022205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:43.102538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56699538-980b-47f9-837e-89fa397341a6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:43.124201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:43.154490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5045-ccb2-422e-8822-7f51476f3d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:43.155713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5045-ccb2-422e-8822-7f51476f3d2e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:43.156455 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5045-ccb2-422e-8822-7f51476f3d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:43.156945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b5045-ccb2-422e-8822-7f51476f3d2e None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:43.159631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b5045-ccb2-422e-8822-7f51476f3d2e None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:43.161949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3ce2-9c29-450d-a818-c6fe8480b2d9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:43.162904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b5045-ccb2-422e-8822-7f51476f3d2e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:43.165355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 183/367] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:42 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:43.169391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5045-ccb2-422e-8822-7f51476f3d2e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:43.205527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:43.229931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e718-e1f9-48c5-a4eb-59eedae3dbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:43.230603 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e718-e1f9-48c5-a4eb-59eedae3dbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:43.230887 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e718-e1f9-48c5-a4eb-59eedae3dbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:43.231170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0e718-e1f9-48c5-a4eb-59eedae3dbc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:43.256713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0e718-e1f9-48c5-a4eb-59eedae3dbc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1bf0e718-e1f9-48c5-a4eb-59eedae3dbc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:43.262206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:43.263123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:43.263963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:43.266215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 185/368] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:43.270389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e718-e1f9-48c5-a4eb-59eedae3dbc7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:43.353164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b5045-ccb2-422e-8822-7f51476f3d2e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:43.401187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2fe88-8802-44ad-902a-d15dace80a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:43.402328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2fe88-8802-44ad-902a-d15dace80a27 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:43.402618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2fe88-8802-44ad-902a-d15dace80a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:43.402893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2fe88-8802-44ad-902a-d15dace80a27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:43.423861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2fe88-8802-44ad-902a-d15dace80a27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-19a2fe88-8802-44ad-902a-d15dace80a27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:43.430292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:43.431219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:43.432058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:43.432664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 184/369] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:43.433277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2fe88-8802-44ad-902a-d15dace80a27 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:43.442729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0e718-e1f9-48c5-a4eb-59eedae3dbc7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:43.494878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:43.495613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:43.495992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:43.496343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:43.497152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] RBAC: Adding query filter params (group.id=db8b89fb7e2d4d8182c1a23584945623, role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:43.497538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:43.499958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:43.511381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 186/370] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:43 2022] GET /identity/v3/role_assignments?group.id=db8b89fb7e2d4d8182c1a23584945623&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=cf033ca534d941b5b3284c687e715647 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:43.512417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:43.521201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:43.606482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2fe88-8802-44ad-902a-d15dace80a27 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:43.636068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:43.654135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:43.655093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:43.655993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:43.656447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:43.657301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:43.657918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:43.660739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:43.675384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 185/371] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:43.682938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:43.750822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1b6bb-8afa-4fd3-9f26-7ddabca9016d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:43.822343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:43.822963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:43.823252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:43.823536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:43.824263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:43.824574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:43.825957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:43.841638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 187/372] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:43.842539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc258fd-9f66-4ba4-a046-56e75a4aacb4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:43.851798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:43.857825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:43.919370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361c4d7-0a9b-4762-8f17-651753eba881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:43.921413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c4d7-0a9b-4762-8f17-651753eba881 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:43.922891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c4d7-0a9b-4762-8f17-651753eba881 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:43.923364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361c4d7-0a9b-4762-8f17-651753eba881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:44.055754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361c4d7-0a9b-4762-8f17-651753eba881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:44.058515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361c4d7-0a9b-4762-8f17-651753eba881 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:44.071445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c401045-0ff6-489c-a467-b881bf26bb36 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:44.084619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:44.115408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b7da1-8e6d-4701-98db-0570555446ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:44.116422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b7da1-8e6d-4701-98db-0570555446ae None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:44.116922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b7da1-8e6d-4701-98db-0570555446ae None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:44.117406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b7da1-8e6d-4701-98db-0570555446ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:44.203288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b7da1-8e6d-4701-98db-0570555446ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:44.204847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b7da1-8e6d-4701-98db-0570555446ae None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:44.255202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 186/373] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:57:44.261108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361c4d7-0a9b-4762-8f17-651753eba881 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:44.270173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:44.391670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361c4d7-0a9b-4762-8f17-651753eba881 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:44.413867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 188/374] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:57:44.415405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb620-bad4-4156-81b3-70fa164d6b5f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:44.415696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb620-bad4-4156-81b3-70fa164d6b5f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:44.415999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7cb620-bad4-4156-81b3-70fa164d6b5f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:44.422972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 189/375] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:44.423839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb620-bad4-4156-81b3-70fa164d6b5f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:44.442238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:44.445282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6be0d-353a-4d7a-b6d1-00a2450706d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:44.446147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6be0d-353a-4d7a-b6d1-00a2450706d5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:44.446638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6be0d-353a-4d7a-b6d1-00a2450706d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:44.447093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6be0d-353a-4d7a-b6d1-00a2450706d5 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:44.449256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6be0d-353a-4d7a-b6d1-00a2450706d5 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:44.451437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6be0d-353a-4d7a-b6d1-00a2450706d5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:44.456366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 187/376] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:44 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:44.461513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44e5c-1c37-459a-a12f-c24ab45e5fb5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:44.461513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44e5c-1c37-459a-a12f-c24ab45e5fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:44.461513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee44e5c-1c37-459a-a12f-c24ab45e5fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:44.484788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1ee44e5c-1c37-459a-a12f-c24ab45e5fb5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:44.486028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1ee44e5c-1c37-459a-a12f-c24ab45e5fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:44.557958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7cb620-bad4-4156-81b3-70fa164d6b5f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:44.572047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 188/377] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:44.578619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee44e5c-1c37-459a-a12f-c24ab45e5fb5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:44.589571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:44.602425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f6df6-8e18-44f3-ba05-4399464ea741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:44.603367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6df6-8e18-44f3-ba05-4399464ea741 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:44.603862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6df6-8e18-44f3-ba05-4399464ea741 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:44.604681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f6df6-8e18-44f3-ba05-4399464ea741 None admin] PATH_INFO: `/v3/projects/6563c9a51480471196235c4b00b7535a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:44.606008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f6df6-8e18-44f3-ba05-4399464ea741 None admin] RBAC: Authorizing `identity:get_project(project_id=6563c9a51480471196235c4b00b7535a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:44.607625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f6df6-8e18-44f3-ba05-4399464ea741 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:44.609838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 190/378] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:44 2022] GET /identity/v3/projects/6563c9a51480471196235c4b00b7535a => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:44.616137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f6df6-8e18-44f3-ba05-4399464ea741 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:44.754852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:44.763046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee44e5c-1c37-459a-a12f-c24ab45e5fb5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:44.782231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f6df6-8e18-44f3-ba05-4399464ea741 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:44.808187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb13a-5937-4ec4-aa55-ff89e9e4f7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:44.809222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb13a-5937-4ec4-aa55-ff89e9e4f7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:44.809723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb13a-5937-4ec4-aa55-ff89e9e4f7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:44.810200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abb13a-5937-4ec4-aa55-ff89e9e4f7a5 None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:44.815097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb13a-5937-4ec4-aa55-ff89e9e4f7a5 None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:44.816980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abb13a-5937-4ec4-aa55-ff89e9e4f7a5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:44.819133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 189/379] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:44 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:44.825469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb13a-5937-4ec4-aa55-ff89e9e4f7a5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:44.829480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6817d-49b3-47f9-9877-9bf28eac1a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:44.830127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6817d-49b3-47f9-9877-9bf28eac1a58 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:44.830944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6817d-49b3-47f9-9877-9bf28eac1a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:44.831222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6817d-49b3-47f9-9877-9bf28eac1a58 None admin] PATH_INFO: `/v3/groups/044b9c3c12ae414e981d508d50789874` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:44.848424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6817d-49b3-47f9-9877-9bf28eac1a58 None admin] RBAC: Authorizing `identity:get_group(group_id=044b9c3c12ae414e981d508d50789874)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:44.849905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6817d-49b3-47f9-9877-9bf28eac1a58 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:44.851935 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 191/380] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:44 2022] GET /identity/v3/groups/044b9c3c12ae414e981d508d50789874 => generated 229 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:44.860709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6817d-49b3-47f9-9877-9bf28eac1a58 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:44.938741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:44.982874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abb13a-5937-4ec4-aa55-ff89e9e4f7a5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:44.993493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6817d-49b3-47f9-9877-9bf28eac1a58 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:45.030213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:45.030744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:45.031018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:45.031288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:45.032068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] RBAC: Adding query filter params (group.id=db8b89fb7e2d4d8182c1a23584945623, role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:45.032382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:45.034481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:45.041126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 190/381] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:44 2022] GET /identity/v3/role_assignments?group.id=db8b89fb7e2d4d8182c1a23584945623&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=d2a640c46df448be87633e4dd910c74f => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:45.041712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:45.042028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:45.043029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:45.043830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:45.044589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:45.046244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] RBAC: Adding query filter params (group.id=044b9c3c12ae414e981d508d50789874, role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=6563c9a51480471196235c4b00b7535a) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:45.047110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:45.050816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:45.058743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 192/382] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:44 2022] GET /identity/v3/role_assignments?group.id=044b9c3c12ae414e981d508d50789874&scope.project.id=6563c9a51480471196235c4b00b7535a&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:45.179804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1113f8-b20c-4715-950a-961df15b3d13 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:45.231356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2636-afa1-4ea9-b5a2-65a0cfe2e279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:45.232351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2636-afa1-4ea9-b5a2-65a0cfe2e279 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:45.232845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2636-afa1-4ea9-b5a2-65a0cfe2e279 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:45.233298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be2636-afa1-4ea9-b5a2-65a0cfe2e279 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:45.236798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:45.247888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be2636-afa1-4ea9-b5a2-65a0cfe2e279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-e7be2636-afa1-4ea9-b5a2-65a0cfe2e279 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:45.254062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:45.255018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:45.255840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:45.257876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 191/383] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:45.264056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:45.269118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:45.401776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f28f6f-d662-4ffe-a4db-3224a9f94a92 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:45.446391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:45.447398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:45.447684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:45.448039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:45.448722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:45.449025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:45.450389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:45.462267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 193/384] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:45.467471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2636-afa1-4ea9-b5a2-65a0cfe2e279 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:45.590524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be2636-afa1-4ea9-b5a2-65a0cfe2e279 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:45.632270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650750fd-d36e-4e5e-bdd0-33752e6b1c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:45.632913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650750fd-d36e-4e5e-bdd0-33752e6b1c99 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:45.633192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650750fd-d36e-4e5e-bdd0-33752e6b1c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:45.633464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650750fd-d36e-4e5e-bdd0-33752e6b1c99 None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:45.635018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650750fd-d36e-4e5e-bdd0-33752e6b1c99 None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:45.636479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650750fd-d36e-4e5e-bdd0-33752e6b1c99 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:45.638341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 192/385] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:45 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:45.644187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:45.680427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0113d1-4de5-4e67-8cff-6aab9e17f15d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:45.680953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0113d1-4de5-4e67-8cff-6aab9e17f15d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:45.681425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0113d1-4de5-4e67-8cff-6aab9e17f15d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:45.683438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 193/386] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:45.688534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8999a8-fb6b-4904-8088-ce020e704343 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:45.689073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8999a8-fb6b-4904-8088-ce020e704343 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:45.689544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8999a8-fb6b-4904-8088-ce020e704343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:45.714289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5f8999a8-fb6b-4904-8088-ce020e704343 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:45.716067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5f8999a8-fb6b-4904-8088-ce020e704343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:45.732036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:45.787858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc17a6-b46d-4d34-be53-fb2127240054 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:45.844327 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e6605-c3fe-47a3-bd94-a9e6b485e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:45.845323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6605-c3fe-47a3-bd94-a9e6b485e20a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:45.845827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6605-c3fe-47a3-bd94-a9e6b485e20a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:45.846924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e6605-c3fe-47a3-bd94-a9e6b485e20a None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:45.848613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e6605-c3fe-47a3-bd94-a9e6b485e20a None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:45.850237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e6605-c3fe-47a3-bd94-a9e6b485e20a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:45.853879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 194/387] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:45 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:45.858828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:45.859998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e6605-c3fe-47a3-bd94-a9e6b485e20a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:45.877346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 194/388] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:45.978485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e6605-c3fe-47a3-bd94-a9e6b485e20a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:46.015757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94b10d-91bf-42ec-a1e6-216921c4492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:46.016844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b10d-91bf-42ec-a1e6-216921c4492e None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:46.017411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b10d-91bf-42ec-a1e6-216921c4492e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:46.017936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94b10d-91bf-42ec-a1e6-216921c4492e None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f/groups/db8b89fb7e2d4d8182c1a23584945623/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:46.020119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94b10d-91bf-42ec-a1e6-216921c4492e None admin] RBAC: Authorizing `identity:create_grant(project_id=370870b74de0407a9d8619b669b6f45f, group_id=db8b89fb7e2d4d8182c1a23584945623, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:46.022010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94b10d-91bf-42ec-a1e6-216921c4492e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:46.024572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:46.139375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 195/389] 10.222.0.82 () {58 vars in 1442 bytes} [Mon Aug 29 18:57:45 2022] PUT /identity/v3/projects/370870b74de0407a9d8619b669b6f45f/groups/db8b89fb7e2d4d8182c1a23584945623/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 18:57:46.229329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dedd0d-e1b6-48ed-a56d-a3c691094970 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:46.229672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dedd0d-e1b6-48ed-a56d-a3c691094970 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:46.230045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dedd0d-e1b6-48ed-a56d-a3c691094970 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:46.231748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 195/390] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:46.237657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e57c-0009-40ce-97f7-6e6088dca55d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:46.238054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e57c-0009-40ce-97f7-6e6088dca55d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:46.238422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2e57c-0009-40ce-97f7-6e6088dca55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:46.255035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dedd0d-e1b6-48ed-a56d-a3c691094970 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:46.259408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-59f2e57c-0009-40ce-97f7-6e6088dca55d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:46.260665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-59f2e57c-0009-40ce-97f7-6e6088dca55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:46.352649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 196/391] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:46.436018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dedd0d-e1b6-48ed-a56d-a3c691094970 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:46.474939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2755cd-4081-41ee-99f3-3cbaa90d54f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:46.475611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2755cd-4081-41ee-99f3-3cbaa90d54f8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:46.475895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2755cd-4081-41ee-99f3-3cbaa90d54f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:46.476166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2755cd-4081-41ee-99f3-3cbaa90d54f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:46.487630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2755cd-4081-41ee-99f3-3cbaa90d54f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4f2755cd-4081-41ee-99f3-3cbaa90d54f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:46.492610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:46.493485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:46.494318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 196/392] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:46.499699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2e57c-0009-40ce-97f7-6e6088dca55d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:46.623764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2e57c-0009-40ce-97f7-6e6088dca55d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:46.650457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:46.661992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:46.662774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:46.663117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:46.663376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:46.664102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:46.664402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:46.665878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:46.675763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 197/393] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:46.683550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2755cd-4081-41ee-99f3-3cbaa90d54f8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:46.771182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:46.806846 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:46.824725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2755cd-4081-41ee-99f3-3cbaa90d54f8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:46.869451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7e70-fe62-4931-a9b5-a1a274bd8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:46.870092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7e70-fe62-4931-a9b5-a1a274bd8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:46.870370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7e70-fe62-4931-a9b5-a1a274bd8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:46.870642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d7e70-fe62-4931-a9b5-a1a274bd8ad3 None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:46.871771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7e70-fe62-4931-a9b5-a1a274bd8ad3 None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:46.873212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d7e70-fe62-4931-a9b5-a1a274bd8ad3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:46.879844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 197/394] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:46 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:46.881318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7e70-fe62-4931-a9b5-a1a274bd8ad3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:46.971955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013b859-2a19-4bec-b646-20cecd7679a5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:47.013722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d7e70-fe62-4931-a9b5-a1a274bd8ad3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:47.027175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf22a-e5a2-45f4-98c5-ff3b7e6e7627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:47.027868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf22a-e5a2-45f4-98c5-ff3b7e6e7627 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.028151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf22a-e5a2-45f4-98c5-ff3b7e6e7627 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.028428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cf22a-e5a2-45f4-98c5-ff3b7e6e7627 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.043181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56cf22a-e5a2-45f4-98c5-ff3b7e6e7627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:47.046454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e56cf22a-e5a2-45f4-98c5-ff3b7e6e7627 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:47.050411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:47.051645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:47.052835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 198/395] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:47.081016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf22a-e5a2-45f4-98c5-ff3b7e6e7627 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:47.086331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739cc5-c814-4996-9eae-0096b9f3aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:47.087257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739cc5-c814-4996-9eae-0096b9f3aee6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.087866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739cc5-c814-4996-9eae-0096b9f3aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.088362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37739cc5-c814-4996-9eae-0096b9f3aee6 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.089730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37739cc5-c814-4996-9eae-0096b9f3aee6 None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:47.091540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37739cc5-c814-4996-9eae-0096b9f3aee6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:47.093725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 198/396] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:46 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:47.101182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739cc5-c814-4996-9eae-0096b9f3aee6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:47.185680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:47.294292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cf22a-e5a2-45f4-98c5-ff3b7e6e7627 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:47.328971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37739cc5-c814-4996-9eae-0096b9f3aee6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:47.368397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:47.369406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.369589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2d2a-2089-42a2-82b3-9f09d6f31e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:47.370085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.370327 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2d2a-2089-42a2-82b3-9f09d6f31e1a None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.370621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2d2a-2089-42a2-82b3-9f09d6f31e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.370904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d2d2a-2089-42a2-82b3-9f09d6f31e1a None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f/groups/db8b89fb7e2d4d8182c1a23584945623/roles/d2a640c46df448be87633e4dd910c74f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.371172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.372063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:47.372578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:47.373155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d2d2a-2089-42a2-82b3-9f09d6f31e1a None admin] RBAC: Authorizing `identity:create_grant(project_id=370870b74de0407a9d8619b669b6f45f, group_id=db8b89fb7e2d4d8182c1a23584945623, role_id=d2a640c46df448be87633e4dd910c74f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:47.374492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:47.375072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579d2d2a-2089-42a2-82b3-9f09d6f31e1a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:47.392443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 199/397] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:47.399035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:47.475145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 199/398] 10.222.0.82 () {58 vars in 1442 bytes} [Mon Aug 29 18:57:47 2022] PUT /identity/v3/projects/370870b74de0407a9d8619b669b6f45f/groups/db8b89fb7e2d4d8182c1a23584945623/roles/d2a640c46df448be87633e4dd910c74f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:47.524590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a6a19-c92a-4239-99cc-cbbce342befb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:47.535518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:47.566122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2901f77-2741-44b5-9517-aae6828b4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:47.566683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901f77-2741-44b5-9517-aae6828b4b05 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.566971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901f77-2741-44b5-9517-aae6828b4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.567251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2901f77-2741-44b5-9517-aae6828b4b05 None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.568477 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2901f77-2741-44b5-9517-aae6828b4b05 None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:47.570173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2901f77-2741-44b5-9517-aae6828b4b05 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:47.572004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 200/399] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:47 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:47.577917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2d2a-2089-42a2-82b3-9f09d6f31e1a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:47.637565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afbc2-4122-4657-bc88-6bbeb631d4df None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.637913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afbc2-4122-4657-bc88-6bbeb631d4df None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.638136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62afbc2-4122-4657-bc88-6bbeb631d4df None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.639673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 201/400] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:47.649752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba11af-554a-4b8f-9fd9-4147b0082050 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.650211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba11af-554a-4b8f-9fd9-4147b0082050 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.650486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba11af-554a-4b8f-9fd9-4147b0082050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.663020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:47.672493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-93ba11af-554a-4b8f-9fd9-4147b0082050 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:47.673716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-93ba11af-554a-4b8f-9fd9-4147b0082050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:47.719402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d2d2a-2089-42a2-82b3-9f09d6f31e1a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:47.754443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184c26c-0fd7-4d8a-9120-3e2acf87f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:47.754963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 202/401] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:47.755658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c26c-0fd7-4d8a-9120-3e2acf87f881 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.758535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c26c-0fd7-4d8a-9120-3e2acf87f881 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.758812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184c26c-0fd7-4d8a-9120-3e2acf87f881 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.760066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184c26c-0fd7-4d8a-9120-3e2acf87f881 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:47.761515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184c26c-0fd7-4d8a-9120-3e2acf87f881 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:47.763159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 200/402] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:47 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:47.775126 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba11af-554a-4b8f-9fd9-4147b0082050 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:47.870333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e962dc-f7a4-439e-b711-5c4ddf0287f5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.870515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e962dc-f7a4-439e-b711-5c4ddf0287f5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.870792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e962dc-f7a4-439e-b711-5c4ddf0287f5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.872161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 201/403] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:47.877874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97518-7d8a-43f0-bf7c-71a83c800d3d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.878164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97518-7d8a-43f0-bf7c-71a83c800d3d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.878442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97518-7d8a-43f0-bf7c-71a83c800d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.915560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-19d97518-7d8a-43f0-bf7c-71a83c800d3d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:47.916794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-19d97518-7d8a-43f0-bf7c-71a83c800d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:47.933117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba11af-554a-4b8f-9fd9-4147b0082050 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:47.946811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:47.985688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ac640-d872-4583-8c48-8ea7ba401c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:47.986355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac640-d872-4583-8c48-8ea7ba401c03 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:47.987199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac640-d872-4583-8c48-8ea7ba401c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:47.987482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ac640-d872-4583-8c48-8ea7ba401c03 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/groups/db8b89fb7e2d4d8182c1a23584945623/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:47.990702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ac640-d872-4583-8c48-8ea7ba401c03 None admin] RBAC: Authorizing `identity:create_grant(project_id=c080bc0c25374fe7867a8a2a06a093a8, group_id=db8b89fb7e2d4d8182c1a23584945623, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:47.992181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ac640-d872-4583-8c48-8ea7ba401c03 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:48.030588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 202/404] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:48.047303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d97518-7d8a-43f0-bf7c-71a83c800d3d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:48.081902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 203/405] 10.222.0.82 () {58 vars in 1442 bytes} [Mon Aug 29 18:57:47 2022] PUT /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/groups/db8b89fb7e2d4d8182c1a23584945623/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:48.110717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:48.174925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d97518-7d8a-43f0-bf7c-71a83c800d3d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:48.218373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf08e-7352-4cf6-8d6f-dd6bf94ce5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:48.219033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf08e-7352-4cf6-8d6f-dd6bf94ce5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:48.219313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf08e-7352-4cf6-8d6f-dd6bf94ce5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:48.219590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbf08e-7352-4cf6-8d6f-dd6bf94ce5a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:48.238963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbf08e-7352-4cf6-8d6f-dd6bf94ce5a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c2bbf08e-7352-4cf6-8d6f-dd6bf94ce5a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:48.246350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:48.247314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:48.248174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 203/406] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:48.255755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ac640-d872-4583-8c48-8ea7ba401c03 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:48.373816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ac640-d872-4583-8c48-8ea7ba401c03 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:48.414838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf08e-7352-4cf6-8d6f-dd6bf94ce5a6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:48.415051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:48.415854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:48.423551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:48.423551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:48.423551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:48.423551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:48.423551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:48.429754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 204/407] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:48.436476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:48.496138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:48.624018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdfbb-c245-4a02-9687-d7c85ffe46df None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:48.626659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbf08e-7352-4cf6-8d6f-dd6bf94ce5a6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:48.645950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:48.660490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2fbf1-7a3b-4eca-a920-b0a059d8b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:48.669686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2fbf1-7a3b-4eca-a920-b0a059d8b113 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:48.669686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2fbf1-7a3b-4eca-a920-b0a059d8b113 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:48.669686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2fbf1-7a3b-4eca-a920-b0a059d8b113 None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:48.669686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2fbf1-7a3b-4eca-a920-b0a059d8b113 None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:48.669686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2fbf1-7a3b-4eca-a920-b0a059d8b113 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:48.669686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 205/408] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:48 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:48.672005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2fbf1-7a3b-4eca-a920-b0a059d8b113 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:48.699655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7086d05-d166-455c-bead-5ff0c29f094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:48.700286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7086d05-d166-455c-bead-5ff0c29f094e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:48.700563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7086d05-d166-455c-bead-5ff0c29f094e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:48.700831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7086d05-d166-455c-bead-5ff0c29f094e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:48.721639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7086d05-d166-455c-bead-5ff0c29f094e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f7086d05-d166-455c-bead-5ff0c29f094e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:48.737853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:48.739629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:48.741272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 204/409] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:48.755584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7086d05-d166-455c-bead-5ff0c29f094e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:48.860106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2fbf1-7a3b-4eca-a920-b0a059d8b113 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:48.868110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:48.924775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50329b89-6755-412a-8754-98c8854400ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:48.925661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50329b89-6755-412a-8754-98c8854400ac None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:48.926383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50329b89-6755-412a-8754-98c8854400ac None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:48.926675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50329b89-6755-412a-8754-98c8854400ac None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:48.928113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50329b89-6755-412a-8754-98c8854400ac None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:48.930523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50329b89-6755-412a-8754-98c8854400ac None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:48.933214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 206/410] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:48 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:48.934398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b16a02-69e1-4424-91b8-f32379b97166 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:48.934687 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b16a02-69e1-4424-91b8-f32379b97166 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:48.934958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b16a02-69e1-4424-91b8-f32379b97166 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:48.936443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 207/411] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:48.940589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b16a02-69e1-4424-91b8-f32379b97166 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:48.942770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7086d05-d166-455c-bead-5ff0c29f094e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:48.984446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617f9c5-b977-492c-b291-49d79699ea25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:48.985059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f9c5-b977-492c-b291-49d79699ea25 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:48.985445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f9c5-b977-492c-b291-49d79699ea25 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:48.985720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617f9c5-b977-492c-b291-49d79699ea25 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:48.986486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f9c5-b977-492c-b291-49d79699ea25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:48.987384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f9c5-b977-492c-b291-49d79699ea25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:48.989077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617f9c5-b977-492c-b291-49d79699ea25 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:49.002793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 205/412] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:49.004316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c6316-1a12-4484-80d0-4b0d71ae86d2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.004607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c6316-1a12-4484-80d0-4b0d71ae86d2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.004883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c6316-1a12-4484-80d0-4b0d71ae86d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.023084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4f6c6316-1a12-4484-80d0-4b0d71ae86d2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:49.024307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4f6c6316-1a12-4484-80d0-4b0d71ae86d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:49.053635 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:49.072218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b16a02-69e1-4424-91b8-f32379b97166 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:49.110871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 206/413] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:49.112040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a4d80-104d-4682-ad2f-1fd177a4d76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:49.112171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c6316-1a12-4484-80d0-4b0d71ae86d2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:49.113048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a4d80-104d-4682-ad2f-1fd177a4d76f None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.113552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a4d80-104d-4682-ad2f-1fd177a4d76f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.114042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a4d80-104d-4682-ad2f-1fd177a4d76f None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/groups/db8b89fb7e2d4d8182c1a23584945623/roles/d2a640c46df448be87633e4dd910c74f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.117235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a4d80-104d-4682-ad2f-1fd177a4d76f None admin] RBAC: Authorizing `identity:create_grant(project_id=c080bc0c25374fe7867a8a2a06a093a8, group_id=db8b89fb7e2d4d8182c1a23584945623, role_id=d2a640c46df448be87633e4dd910c74f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:49.119027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a4d80-104d-4682-ad2f-1fd177a4d76f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:49.206751 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 208/414] 10.222.0.82 () {58 vars in 1442 bytes} [Mon Aug 29 18:57:48 2022] PUT /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8/groups/db8b89fb7e2d4d8182c1a23584945623/roles/d2a640c46df448be87633e4dd910c74f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:57:49.245859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c6316-1a12-4484-80d0-4b0d71ae86d2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:49.289573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d09797-7ea0-4807-b26f-c68885a2f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:49.290228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09797-7ea0-4807-b26f-c68885a2f463 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.290511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09797-7ea0-4807-b26f-c68885a2f463 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.290789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09797-7ea0-4807-b26f-c68885a2f463 None admin] PATH_INFO: `/v3/groups/044b9c3c12ae414e981d508d50789874` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.292035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d09797-7ea0-4807-b26f-c68885a2f463 None admin] RBAC: Authorizing `identity:get_group(group_id=044b9c3c12ae414e981d508d50789874)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:49.293496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d09797-7ea0-4807-b26f-c68885a2f463 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:49.295503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 207/415] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:49 2022] GET /identity/v3/groups/044b9c3c12ae414e981d508d50789874 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:49.303075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a4d80-104d-4682-ad2f-1fd177a4d76f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:49.353769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:49.440885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a4d80-104d-4682-ad2f-1fd177a4d76f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:49.481837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12183-1da2-42da-bbef-cd85f2532d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:49.482630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12183-1da2-42da-bbef-cd85f2532d68 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.482949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12183-1da2-42da-bbef-cd85f2532d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.483267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b12183-1da2-42da-bbef-cd85f2532d68 None admin] PATH_INFO: `/v3/projects/6563c9a51480471196235c4b00b7535a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.484689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b12183-1da2-42da-bbef-cd85f2532d68 None admin] RBAC: Authorizing `identity:get_project(project_id=6563c9a51480471196235c4b00b7535a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:49.487351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b12183-1da2-42da-bbef-cd85f2532d68 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:49.490002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 209/416] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:49 2022] GET /identity/v3/projects/6563c9a51480471196235c4b00b7535a => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:49.495783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d09797-7ea0-4807-b26f-c68885a2f463 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:49.538013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12183-1da2-42da-bbef-cd85f2532d68 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:49.539303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:49.671573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d09797-7ea0-4807-b26f-c68885a2f463 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:49.683351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:49.699752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b12183-1da2-42da-bbef-cd85f2532d68 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:49.733180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88287260-067a-4b4e-a495-e3ad840ede7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:49.733856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88287260-067a-4b4e-a495-e3ad840ede7b None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.734135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88287260-067a-4b4e-a495-e3ad840ede7b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.734404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88287260-067a-4b4e-a495-e3ad840ede7b None admin] PATH_INFO: `/v3/projects/6563c9a51480471196235c4b00b7535a/groups/044b9c3c12ae414e981d508d50789874/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.738608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88287260-067a-4b4e-a495-e3ad840ede7b None admin] RBAC: Authorizing `identity:create_grant(project_id=6563c9a51480471196235c4b00b7535a, group_id=044b9c3c12ae414e981d508d50789874, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:49.740078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88287260-067a-4b4e-a495-e3ad840ede7b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:49.757317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5128d-af8d-4b2d-93e3-75ef7f958f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:49.757997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5128d-af8d-4b2d-93e3-75ef7f958f21 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.763092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5128d-af8d-4b2d-93e3-75ef7f958f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.763092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5128d-af8d-4b2d-93e3-75ef7f958f21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.769319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5128d-af8d-4b2d-93e3-75ef7f958f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-57d5128d-af8d-4b2d-93e3-75ef7f958f21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:49.775648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:49.776626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:49.777456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 210/417] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:49.785610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5128d-af8d-4b2d-93e3-75ef7f958f21 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:49.813913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 208/418] 10.222.0.82 () {58 vars in 1442 bytes} [Mon Aug 29 18:57:49 2022] PUT /identity/v3/projects/6563c9a51480471196235c4b00b7535a/groups/044b9c3c12ae414e981d508d50789874/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 18:57:49.890263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369254-33f4-4607-a008-ae7fd19a7e6b None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.890628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369254-33f4-4607-a008-ae7fd19a7e6b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.890867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c369254-33f4-4607-a008-ae7fd19a7e6b None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.892500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 209/419] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:57:49.898835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c45c5c-da09-4aec-a616-86eeb0399b2f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.900035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c45c5c-da09-4aec-a616-86eeb0399b2f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.900035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c45c5c-da09-4aec-a616-86eeb0399b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.915110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5128d-af8d-4b2d-93e3-75ef7f958f21 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:49.923550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e4c45c5c-da09-4aec-a616-86eeb0399b2f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:49.925994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e4c45c5c-da09-4aec-a616-86eeb0399b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:49.972578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:49.973281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:49.973491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:49.973766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:49.974463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:49.974769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:49.976208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:50.007105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 211/420] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:50.012297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:50.036680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:50.055754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 210/421] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:50.135988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9991eb0-c19d-4438-90fb-43ef033551a6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:50.179259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab530514-9cc8-4643-9a9d-ebdecb0b5a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:50.179950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab530514-9cc8-4643-9a9d-ebdecb0b5a96 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:50.180230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab530514-9cc8-4643-9a9d-ebdecb0b5a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:50.180503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab530514-9cc8-4643-9a9d-ebdecb0b5a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:50.281744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab530514-9cc8-4643-9a9d-ebdecb0b5a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:50.283245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab530514-9cc8-4643-9a9d-ebdecb0b5a96 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:50.298701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:50.415475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 212/422] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:57:50.421115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c45c5c-da09-4aec-a616-86eeb0399b2f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:50.446732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:50.472997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab530514-9cc8-4643-9a9d-ebdecb0b5a96 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:50.577093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c45c5c-da09-4aec-a616-86eeb0399b2f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:50.600012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab530514-9cc8-4643-9a9d-ebdecb0b5a96 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:50.617586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f7ebe-4337-40bc-acba-89051b1ab50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:50.618586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:50.620032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7ebe-4337-40bc-acba-89051b1ab50c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:50.620566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7ebe-4337-40bc-acba-89051b1ab50c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:50.621049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f7ebe-4337-40bc-acba-89051b1ab50c None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:50.622638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f7ebe-4337-40bc-acba-89051b1ab50c None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:50.624575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027f7ebe-4337-40bc-acba-89051b1ab50c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:50.627610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 211/423] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:50 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:50.629113 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea9bf-637e-48ae-9371-6d28bb5558fe None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:50.629563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea9bf-637e-48ae-9371-6d28bb5558fe None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:50.630007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ea9bf-637e-48ae-9371-6d28bb5558fe None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:50.635774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 212/424] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:50.636916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ea9bf-637e-48ae-9371-6d28bb5558fe None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:50.645573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f473e-ea4d-4a9e-b28f-d732e919e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:50.646222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f473e-ea4d-4a9e-b28f-d732e919e027 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:50.646499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f473e-ea4d-4a9e-b28f-d732e919e027 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:50.646773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f473e-ea4d-4a9e-b28f-d732e919e027 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:50.661384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f473e-ea4d-4a9e-b28f-d732e919e027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1c2f473e-ea4d-4a9e-b28f-d732e919e027 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:50.667342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:50.668267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:50.669055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 213/425] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:50.670222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6633e-d77b-4de8-85ad-e40cd9defc0b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:50.670419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6633e-d77b-4de8-85ad-e40cd9defc0b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:50.670693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6633e-d77b-4de8-85ad-e40cd9defc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:50.698717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4cf6633e-d77b-4de8-85ad-e40cd9defc0b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:50.700228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4cf6633e-d77b-4de8-85ad-e40cd9defc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:50.748646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:50.768255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ea9bf-637e-48ae-9371-6d28bb5558fe None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:50.787762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 214/426] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:50.788896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6633e-d77b-4de8-85ad-e40cd9defc0b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:50.811218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67927-96bd-4a94-aa1e-f6487b2e5cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:50.811884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67927-96bd-4a94-aa1e-f6487b2e5cfa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:50.812170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67927-96bd-4a94-aa1e-f6487b2e5cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:50.812451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67927-96bd-4a94-aa1e-f6487b2e5cfa None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:50.813581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce67927-96bd-4a94-aa1e-f6487b2e5cfa None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:50.816007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce67927-96bd-4a94-aa1e-f6487b2e5cfa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:50.817826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 213/427] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:50 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:50.824311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67927-96bd-4a94-aa1e-f6487b2e5cfa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:50.941905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67927-96bd-4a94-aa1e-f6487b2e5cfa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:50.970111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6633e-d77b-4de8-85ad-e40cd9defc0b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:50.980328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:50.980942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:50.981223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:50.981498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:50.981940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:50.982361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] RBAC: Adding query filter params (group.id=db8b89fb7e2d4d8182c1a23584945623, role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=370870b74de0407a9d8619b669b6f45f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:50.982532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:50.983988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:50.990903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 214/428] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:50 2022] GET /identity/v3/role_assignments?group.id=db8b89fb7e2d4d8182c1a23584945623&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=cf033ca534d941b5b3284c687e715647 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:51.019854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:51.020566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.020843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.021115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.021809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:51.022111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:51.023497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:51.037787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 215/429] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:51.040974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:51.074222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:51.178579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f708e-9c21-40ae-82b2-892d83853ac0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:51.192102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:51.233375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9bd09-bee8-4870-97e1-9a83a6dd63b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:51.234018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9bd09-bee8-4870-97e1-9a83a6dd63b7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.234301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9bd09-bee8-4870-97e1-9a83a6dd63b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.234579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9bd09-bee8-4870-97e1-9a83a6dd63b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.321946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9bd09-bee8-4870-97e1-9a83a6dd63b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:51.323457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9bd09-bee8-4870-97e1-9a83a6dd63b7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:51.343322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:51.347270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f34b9-f98d-48c0-b579-ce57480777ef None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:51.390401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fd628-2bb9-4cb6-b017-70aa9fd2a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:51.391709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd628-2bb9-4cb6-b017-70aa9fd2a20e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.392246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd628-2bb9-4cb6-b017-70aa9fd2a20e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.392773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fd628-2bb9-4cb6-b017-70aa9fd2a20e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.404943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fd628-2bb9-4cb6-b017-70aa9fd2a20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8d2fd628-2bb9-4cb6-b017-70aa9fd2a20e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:51.410612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:51.411489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 18:57:51.412386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:51.415210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 216/430] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:51.421503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fd628-2bb9-4cb6-b017-70aa9fd2a20e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:51.431899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 215/431] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:51.441435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9bd09-bee8-4870-97e1-9a83a6dd63b7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:51.455788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:51.547818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fd628-2bb9-4cb6-b017-70aa9fd2a20e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:51.562716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9bd09-bee8-4870-97e1-9a83a6dd63b7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:51.590620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:51.602757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:51.603670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.604119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.604491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.605946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:51.605946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:51.606831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:51.617155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71bdd7-82c1-47d2-b6dc-e665c424cba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:51.617368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 217/432] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:57:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:51.618264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71bdd7-82c1-47d2-b6dc-e665c424cba8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.618550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71bdd7-82c1-47d2-b6dc-e665c424cba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.618820 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71bdd7-82c1-47d2-b6dc-e665c424cba8 None admin] PATH_INFO: `/v3/projects/370870b74de0407a9d8619b669b6f45f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.623356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71bdd7-82c1-47d2-b6dc-e665c424cba8 None admin] RBAC: Authorizing `identity:get_project(project_id=370870b74de0407a9d8619b669b6f45f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:51.623356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71bdd7-82c1-47d2-b6dc-e665c424cba8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:51.623356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 216/433] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:51 2022] GET /identity/v3/projects/370870b74de0407a9d8619b669b6f45f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:51.624742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:51.631639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71bdd7-82c1-47d2-b6dc-e665c424cba8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:51.758214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:51.764393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71bdd7-82c1-47d2-b6dc-e665c424cba8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:51.771293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c394aef-f561-46cd-8640-4de3eecea3ee None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:51.813282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe078a2a-dc2a-40ce-82ac-4f893978a4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:51.814096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe078a2a-dc2a-40ce-82ac-4f893978a4ca None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.814431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe078a2a-dc2a-40ce-82ac-4f893978a4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.814886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe078a2a-dc2a-40ce-82ac-4f893978a4ca None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.816224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe078a2a-dc2a-40ce-82ac-4f893978a4ca None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:51.817739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe078a2a-dc2a-40ce-82ac-4f893978a4ca None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:51.820129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 217/434] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:51 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:51.821021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9b93-8296-4e4a-bc65-a4a698700545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:51.821749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9b93-8296-4e4a-bc65-a4a698700545 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.822090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6199-8281-48d0-a5a2-fa6c4c551ad2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.822195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9b93-8296-4e4a-bc65-a4a698700545 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.822436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9b93-8296-4e4a-bc65-a4a698700545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.822858 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6199-8281-48d0-a5a2-fa6c4c551ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.823515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e6199-8281-48d0-a5a2-fa6c4c551ad2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.828678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 218/435] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:51.831156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d47dd-81c1-4641-a912-e801860ac35d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:51.831450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d47dd-81c1-4641-a912-e801860ac35d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:51.831767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d47dd-81c1-4641-a912-e801860ac35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:51.855835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0a0d47dd-81c1-4641-a912-e801860ac35d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:51.857055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0a0d47dd-81c1-4641-a912-e801860ac35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:51.916913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9b93-8296-4e4a-bc65-a4a698700545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:51.918811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9b93-8296-4e4a-bc65-a4a698700545 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:51.928420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:51.948367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 219/436] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:51.960381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d47dd-81c1-4641-a912-e801860ac35d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.017843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:52.033699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 218/437] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:52.044747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9b93-8296-4e4a-bc65-a4a698700545 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.097363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d47dd-81c1-4641-a912-e801860ac35d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.140961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9b93-8296-4e4a-bc65-a4a698700545 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.143867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e17fc-ec0f-4da4-ba8f-6dabf32bfae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.147070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e17fc-ec0f-4da4-ba8f-6dabf32bfae2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.147070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e17fc-ec0f-4da4-ba8f-6dabf32bfae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.147070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e17fc-ec0f-4da4-ba8f-6dabf32bfae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.147070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e17fc-ec0f-4da4-ba8f-6dabf32bfae2 None admin] RBAC: Adding query filter params (group.id=db8b89fb7e2d4d8182c1a23584945623, role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=370870b74de0407a9d8619b669b6f45f) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:52.147070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e17fc-ec0f-4da4-ba8f-6dabf32bfae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:52.147663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e17fc-ec0f-4da4-ba8f-6dabf32bfae2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:52.158044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 220/438] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:51 2022] GET /identity/v3/role_assignments?group.id=db8b89fb7e2d4d8182c1a23584945623&scope.project.id=370870b74de0407a9d8619b669b6f45f&role.id=d2a640c46df448be87633e4dd910c74f => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:52.165381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244bd04-e444-4167-83bf-497b1b8e7391 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.165773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244bd04-e444-4167-83bf-497b1b8e7391 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.167775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244bd04-e444-4167-83bf-497b1b8e7391 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.167775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 221/439] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:52.173313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4fad2-81c9-41ef-8066-d55b2c374318 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.174375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4fad2-81c9-41ef-8066-d55b2c374318 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.174881 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4fad2-81c9-41ef-8066-d55b2c374318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.193982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e83ef-3151-47ea-a03a-c0517f4cfbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.195068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e83ef-3151-47ea-a03a-c0517f4cfbee None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.195350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-40f4fad2-81c9-41ef-8066-d55b2c374318 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:52.195576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e83ef-3151-47ea-a03a-c0517f4cfbee None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.196024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e83ef-3151-47ea-a03a-c0517f4cfbee None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.197165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-40f4fad2-81c9-41ef-8066-d55b2c374318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:52.197482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e83ef-3151-47ea-a03a-c0517f4cfbee None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:52.199098 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e83ef-3151-47ea-a03a-c0517f4cfbee None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:52.205380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 219/440] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:52 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:52.208325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e83ef-3151-47ea-a03a-c0517f4cfbee None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.260608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:52.289847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:52.290139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 222/441] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:57:52.290139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4fad2-81c9-41ef-8066-d55b2c374318 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.338691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e83ef-3151-47ea-a03a-c0517f4cfbee None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.385740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4f81-e578-4bdb-bb52-0501c8abc5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.386385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4f81-e578-4bdb-bb52-0501c8abc5cc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.386666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4f81-e578-4bdb-bb52-0501c8abc5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.386935 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4f81-e578-4bdb-bb52-0501c8abc5cc None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.388610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4f81-e578-4bdb-bb52-0501c8abc5cc None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:52.389645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee4f81-e578-4bdb-bb52-0501c8abc5cc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:52.391270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 220/442] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:52 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:52.398159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4f81-e578-4bdb-bb52-0501c8abc5cc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.413827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4fad2-81c9-41ef-8066-d55b2c374318 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.466600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980e366-ef8f-45d7-b035-1e904b2017cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.467303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980e366-ef8f-45d7-b035-1e904b2017cc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.467587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980e366-ef8f-45d7-b035-1e904b2017cc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.467904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980e366-ef8f-45d7-b035-1e904b2017cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.480750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980e366-ef8f-45d7-b035-1e904b2017cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c980e366-ef8f-45d7-b035-1e904b2017cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:52.485676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:52.487379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:52.488352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 223/443] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:52.494981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980e366-ef8f-45d7-b035-1e904b2017cc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.539236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee4f81-e578-4bdb-bb52-0501c8abc5cc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.554843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:52.573225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:52.586691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.587307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.587592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.587956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.589088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] RBAC: Adding query filter params (group.id=db8b89fb7e2d4d8182c1a23584945623, role.id=cf033ca534d941b5b3284c687e715647, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:52.589414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:52.590848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:52.597646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 221/444] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:52 2022] GET /identity/v3/role_assignments?group.id=db8b89fb7e2d4d8182c1a23584945623&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=cf033ca534d941b5b3284c687e715647 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:52.598368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.636283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980e366-ef8f-45d7-b035-1e904b2017cc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.691099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.691683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.691997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.692278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.692965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:52.693271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:52.695037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:52.706727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 224/445] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:52.712327 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.743369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed35300-43a1-479e-8e55-3efbd57bee5b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.785834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed04d1-d21e-44bd-9308-a797abdcd01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.786486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed04d1-d21e-44bd-9308-a797abdcd01f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.786767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed04d1-d21e-44bd-9308-a797abdcd01f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.787043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed04d1-d21e-44bd-9308-a797abdcd01f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.800164 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed04d1-d21e-44bd-9308-a797abdcd01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-91ed04d1-d21e-44bd-9308-a797abdcd01f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:52.805628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:52.806612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:52.807447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 222/446] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:52.812479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed04d1-d21e-44bd-9308-a797abdcd01f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:52.838690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:52.841694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1231a6-3960-42f4-9cdb-66a723c01e12 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.870515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:52.882884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edbec6-896a-4c4f-927b-e479e97ec703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.883706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edbec6-896a-4c4f-927b-e479e97ec703 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.884042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edbec6-896a-4c4f-927b-e479e97ec703 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.884313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edbec6-896a-4c4f-927b-e479e97ec703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.937744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed04d1-d21e-44bd-9308-a797abdcd01f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:52.974263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edbec6-896a-4c4f-927b-e479e97ec703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:52.976135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86edbec6-896a-4c4f-927b-e479e97ec703 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:52.982787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:52.983404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:52.983689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:52.984026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:52.984699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:52.985010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:52.986940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:52.995354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 223/447] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:57:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:53.001275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:53.073903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:53.077429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 225/448] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:57:53.083218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edbec6-896a-4c4f-927b-e479e97ec703 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:53.100033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498288dc-25e2-4238-bfa0-a32d7e74f8f0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:53.110384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:53.134054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783bf7f-7b31-4b26-a41e-da0574cd2330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:53.134661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783bf7f-7b31-4b26-a41e-da0574cd2330 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:53.134996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783bf7f-7b31-4b26-a41e-da0574cd2330 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:53.135320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783bf7f-7b31-4b26-a41e-da0574cd2330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:53.180631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edbec6-896a-4c4f-927b-e479e97ec703 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:53.202399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783bf7f-7b31-4b26-a41e-da0574cd2330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:53.203954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783bf7f-7b31-4b26-a41e-da0574cd2330 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:53.216436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15787ec-b606-4a20-9f6e-4e4ca0666c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:53.217064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15787ec-b606-4a20-9f6e-4e4ca0666c42 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:53.217349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15787ec-b606-4a20-9f6e-4e4ca0666c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:53.217621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15787ec-b606-4a20-9f6e-4e4ca0666c42 None admin] PATH_INFO: `/v3/projects/c080bc0c25374fe7867a8a2a06a093a8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:53.218729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15787ec-b606-4a20-9f6e-4e4ca0666c42 None admin] RBAC: Authorizing `identity:get_project(project_id=c080bc0c25374fe7867a8a2a06a093a8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:53.220173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15787ec-b606-4a20-9f6e-4e4ca0666c42 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:53.222512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 226/449] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:53 2022] GET /identity/v3/projects/c080bc0c25374fe7867a8a2a06a093a8 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:53.227888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15787ec-b606-4a20-9f6e-4e4ca0666c42 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:53.294720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:53.302789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 224/450] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:57:53.308741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783bf7f-7b31-4b26-a41e-da0574cd2330 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:53.319523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:53.330682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15787ec-b606-4a20-9f6e-4e4ca0666c42 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:53.364099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c7fd1-9c59-49e6-b8dd-c76f07a8251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:53.364721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7fd1-9c59-49e6-b8dd-c76f07a8251f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:53.365000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7fd1-9c59-49e6-b8dd-c76f07a8251f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:53.365269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c7fd1-9c59-49e6-b8dd-c76f07a8251f None admin] PATH_INFO: `/v3/groups/db8b89fb7e2d4d8182c1a23584945623` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:53.366372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c7fd1-9c59-49e6-b8dd-c76f07a8251f None admin] RBAC: Authorizing `identity:get_group(group_id=db8b89fb7e2d4d8182c1a23584945623)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:53.367819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c7fd1-9c59-49e6-b8dd-c76f07a8251f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:53.369356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 227/451] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:53 2022] GET /identity/v3/groups/db8b89fb7e2d4d8182c1a23584945623 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:53.375026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c7fd1-9c59-49e6-b8dd-c76f07a8251f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:53.405046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783bf7f-7b31-4b26-a41e-da0574cd2330 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:53.438753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2acb4-7da7-4513-bddd-eab15325ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:53.439390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2acb4-7da7-4513-bddd-eab15325ba12 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:53.439683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2acb4-7da7-4513-bddd-eab15325ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:53.439975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2acb4-7da7-4513-bddd-eab15325ba12 None admin] PATH_INFO: `/v3/projects/6563c9a51480471196235c4b00b7535a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:53.441105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2acb4-7da7-4513-bddd-eab15325ba12 None admin] RBAC: Authorizing `identity:get_project(project_id=6563c9a51480471196235c4b00b7535a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:53.442530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2acb4-7da7-4513-bddd-eab15325ba12 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:53.444202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 225/452] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:57:53 2022] GET /identity/v3/projects/6563c9a51480471196235c4b00b7535a => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:53.449886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2acb4-7da7-4513-bddd-eab15325ba12 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:53.473759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c7fd1-9c59-49e6-b8dd-c76f07a8251f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:53.508304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:53.508909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:53.509194 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:53.509477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:53.510208 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] RBAC: Adding query filter params (group.id=db8b89fb7e2d4d8182c1a23584945623, role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=c080bc0c25374fe7867a8a2a06a093a8) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:53.510519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:53.512021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:53.514710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:53.518160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 228/453] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:53 2022] GET /identity/v3/role_assignments?group.id=db8b89fb7e2d4d8182c1a23584945623&scope.project.id=c080bc0c25374fe7867a8a2a06a093a8&role.id=d2a640c46df448be87633e4dd910c74f => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:53.531996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:53.556775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2acb4-7da7-4513-bddd-eab15325ba12 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:53.593330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff137a-ddf6-4b2b-bdc0-3a866b501b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:53.593889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff137a-ddf6-4b2b-bdc0-3a866b501b25 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:53.594173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff137a-ddf6-4b2b-bdc0-3a866b501b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:53.594447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff137a-ddf6-4b2b-bdc0-3a866b501b25 None admin] PATH_INFO: `/v3/groups/044b9c3c12ae414e981d508d50789874` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:53.596312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff137a-ddf6-4b2b-bdc0-3a866b501b25 None admin] RBAC: Authorizing `identity:get_group(group_id=044b9c3c12ae414e981d508d50789874)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:53.597793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff137a-ddf6-4b2b-bdc0-3a866b501b25 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:53.599439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 226/454] 10.222.0.82 () {56 vars in 1180 bytes} [Mon Aug 29 18:57:53 2022] GET /identity/v3/groups/044b9c3c12ae414e981d508d50789874 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:57:53.605622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:53.713303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e939e66-8023-408d-8342-2ec14d725cc8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:53.747222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68914cb3-c178-467b-a3a0-605a7e026cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:53.747860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68914cb3-c178-467b-a3a0-605a7e026cfa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:53.748143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68914cb3-c178-467b-a3a0-605a7e026cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:53.748417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68914cb3-c178-467b-a3a0-605a7e026cfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:53.749143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68914cb3-c178-467b-a3a0-605a7e026cfa None admin] RBAC: Adding query filter params (group.id=044b9c3c12ae414e981d508d50789874, role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=6563c9a51480471196235c4b00b7535a) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:53.749461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68914cb3-c178-467b-a3a0-605a7e026cfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:53.750899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68914cb3-c178-467b-a3a0-605a7e026cfa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:53.756729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 229/455] 10.222.0.82 () {56 vars in 1376 bytes} [Mon Aug 29 18:57:53 2022] GET /identity/v3/role_assignments?group.id=044b9c3c12ae414e981d508d50789874&scope.project.id=6563c9a51480471196235c4b00b7535a&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:56.048337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946680-0916-498f-9907-bed2703c5a07 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:56.049381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946680-0916-498f-9907-bed2703c5a07 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:56.049456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f946680-0916-498f-9907-bed2703c5a07 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:56.050859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 227/456] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:56.065839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7058-7c24-400f-8620-c8bac32d201a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:56.066344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7058-7c24-400f-8620-c8bac32d201a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:56.066421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7058-7c24-400f-8620-c8bac32d201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:56.092746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6efc7058-7c24-400f-8620-c8bac32d201a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:56.093962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6efc7058-7c24-400f-8620-c8bac32d201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:56.181642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:56.191341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 230/457] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:56.471513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36100-788d-4243-9df8-6bded9f9b909 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:56.471814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36100-788d-4243-9df8-6bded9f9b909 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:56.472267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a36100-788d-4243-9df8-6bded9f9b909 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:56.473919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 228/458] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:56.479444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a012c1c-edd3-4677-bd01-cf9ef0107070 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:56.479760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a012c1c-edd3-4677-bd01-cf9ef0107070 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:56.480048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a012c1c-edd3-4677-bd01-cf9ef0107070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:56.504769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8a012c1c-edd3-4677-bd01-cf9ef0107070 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:56.506048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8a012c1c-edd3-4677-bd01-cf9ef0107070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:56.602040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 231/459] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:56.668192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adaf34-4a15-40ef-97da-5c07b7b99e57 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:56.668809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adaf34-4a15-40ef-97da-5c07b7b99e57 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:56.669289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adaf34-4a15-40ef-97da-5c07b7b99e57 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:56.670808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 229/460] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:56.676356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a3a1-1a11-4dd2-bc02-442a58dddda1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:56.676718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a3a1-1a11-4dd2-bc02-442a58dddda1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:56.677004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1a3a1-1a11-4dd2-bc02-442a58dddda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:56.677888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adaf34-4a15-40ef-97da-5c07b7b99e57 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:56.695790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-95b1a3a1-1a11-4dd2-bc02-442a58dddda1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:56.696987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-95b1a3a1-1a11-4dd2-bc02-442a58dddda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:56.837771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 232/461] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:56.868311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adaf34-4a15-40ef-97da-5c07b7b99e57 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:56.919400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcd1d8-fad6-4206-87f4-b3c197318c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:56.919624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1a3a1-1a11-4dd2-bc02-442a58dddda1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:56.920070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd1d8-fad6-4206-87f4-b3c197318c98 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:56.920352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd1d8-fad6-4206-87f4-b3c197318c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:56.920634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcd1d8-fad6-4206-87f4-b3c197318c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:56.934346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcd1d8-fad6-4206-87f4-b3c197318c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:56.935962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcd1d8-fad6-4206-87f4-b3c197318c98 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:56.971357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bfdcd1d8-fad6-4206-87f4-b3c197318c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:57:56.974224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:56.975198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:57:56.976069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:57:56.976069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:57:56.976069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:57:56.979378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 230/462] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:56.979378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aaf33-16a1-4108-a9fe-bf11a138f3f0 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:56.979378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aaf33-16a1-4108-a9fe-bf11a138f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:56.979378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068aaf33-16a1-4108-a9fe-bf11a138f3f0 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:56.984355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 231/463] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:56.984355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068aaf33-16a1-4108-a9fe-bf11a138f3f0 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:57.012259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:57.063353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1a3a1-1a11-4dd2-bc02-442a58dddda1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.102864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f92ae1-ea9b-4ec6-9bd4-2d1ca612895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:57.107759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92ae1-ea9b-4ec6-9bd4-2d1ca612895f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.107759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92ae1-ea9b-4ec6-9bd4-2d1ca612895f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.107759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f92ae1-ea9b-4ec6-9bd4-2d1ca612895f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.116444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f92ae1-ea9b-4ec6-9bd4-2d1ca612895f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:57.117997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f92ae1-ea9b-4ec6-9bd4-2d1ca612895f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:57.119969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068aaf33-16a1-4108-a9fe-bf11a138f3f0 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f3f92ae1-ea9b-4ec6-9bd4-2d1ca612895f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:57:57.135217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:57.137058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:57:57.139106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:57:57.139106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:57:57.139106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:57.139106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 233/464] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:57.139672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d4e7b-703a-47ec-909b-fe8f9a8d288f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.139672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d4e7b-703a-47ec-909b-fe8f9a8d288f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.147895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d4e7b-703a-47ec-909b-fe8f9a8d288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.159915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:57.160558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.161403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.161683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.162341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:57.162932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:57.164323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:57.167038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-df5d4e7b-703a-47ec-909b-fe8f9a8d288f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:57.168376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-df5d4e7b-703a-47ec-909b-fe8f9a8d288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:57.183355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 232/465] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:57.184547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:57.249784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 234/466] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:57.250901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d4e7b-703a-47ec-909b-fe8f9a8d288f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:57.256007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:57.301512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:57.303861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae8e72-a03c-4b5d-9f94-0e1920ba48cc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.342703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:57.343413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.343834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.344183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.344941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:57.345335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:57.347029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:57.363841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 233/467] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:57.363841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:57.399274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d4e7b-703a-47ec-909b-fe8f9a8d288f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.452976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:57.454439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.455025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.455517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.470171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:57.471844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:57.481962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc80598-1d34-4568-b3f2-d5c54639fb14 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:57:57.488671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:57.489594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:57:57.490431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:57:57.490431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:57:57.490431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:57.490431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 235/468] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:57.490652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:57.513417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:57.542480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbedae-6678-40ee-954a-89cab9df7f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:57.543623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbedae-6678-40ee-954a-89cab9df7f0f None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.544753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbedae-6678-40ee-954a-89cab9df7f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.545340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbedae-6678-40ee-954a-89cab9df7f0f None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.546319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbedae-6678-40ee-954a-89cab9df7f0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:57.549538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edbedae-6678-40ee-954a-89cab9df7f0f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:57.588968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:57.601066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1590fa0f-f868-426e-8b84-79739bd273e3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.631038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 234/469] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:57 2022] POST /identity/v3/users => generated 246 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:57.631979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbedae-6678-40ee-954a-89cab9df7f0f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:57.640840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed3183-9fdd-494d-b595-346610b93819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:57.641483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed3183-9fdd-494d-b595-346610b93819 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.641765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed3183-9fdd-494d-b595-346610b93819 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.642041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed3183-9fdd-494d-b595-346610b93819 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.643237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed3183-9fdd-494d-b595-346610b93819 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:57.644921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed3183-9fdd-494d-b595-346610b93819 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:57.731753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 236/470] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:57 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:57.731753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed3183-9fdd-494d-b595-346610b93819 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:57.755774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbedae-6678-40ee-954a-89cab9df7f0f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.805008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af7a33-2693-4930-9df3-cfe7b58e524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:57.805644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7a33-2693-4930-9df3-cfe7b58e524b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.805926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7a33-2693-4930-9df3-cfe7b58e524b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.806217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af7a33-2693-4930-9df3-cfe7b58e524b None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.806878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7a33-2693-4930-9df3-cfe7b58e524b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:57.807192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7a33-2693-4930-9df3-cfe7b58e524b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:57.808629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af7a33-2693-4930-9df3-cfe7b58e524b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:57.829459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 235/471] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:57.831023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca436-d93c-4da5-b545-1276821d1c94 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.831318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca436-d93c-4da5-b545-1276821d1c94 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.831669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ca436-d93c-4da5-b545-1276821d1c94 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.836616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 236/472] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:57.840646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ca436-d93c-4da5-b545-1276821d1c94 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:57.886907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed3183-9fdd-494d-b595-346610b93819 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.887571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:57.930710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9d89b-e5e0-4df6-85ff-2d18e09d6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:57.931233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9d89b-e5e0-4df6-85ff-2d18e09d6fbc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.931523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9d89b-e5e0-4df6-85ff-2d18e09d6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.932053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9d89b-e5e0-4df6-85ff-2d18e09d6fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.946754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9d89b-e5e0-4df6-85ff-2d18e09d6fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:57.948546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9d89b-e5e0-4df6-85ff-2d18e09d6fbc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:57.956966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d5f9d89b-e5e0-4df6-85ff-2d18e09d6fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:57:57.968797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:57.974137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:57:57.975631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:57:57.975631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:57:57.975631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:57.975631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 237/473] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:57:57.975631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4be29-1394-4adc-90ee-80f3f91707ad None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:57.975631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4be29-1394-4adc-90ee-80f3f91707ad None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:57.975631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4be29-1394-4adc-90ee-80f3f91707ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:57.981694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ca436-d93c-4da5-b545-1276821d1c94 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:57.998522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-95f4be29-1394-4adc-90ee-80f3f91707ad None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:57.999708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-95f4be29-1394-4adc-90ee-80f3f91707ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:58.025263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7c1c5-9ade-416b-9919-e32de5781ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:58.025882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7c1c5-9ade-416b-9919-e32de5781ce6 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:58.026165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7c1c5-9ade-416b-9919-e32de5781ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:58.026438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7c1c5-9ade-416b-9919-e32de5781ce6 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:58.027088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7c1c5-9ade-416b-9919-e32de5781ce6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:58.028774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7c1c5-9ade-416b-9919-e32de5781ce6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:58.109480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 238/474] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:57:58.110845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4be29-1394-4adc-90ee-80f3f91707ad None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:58.143017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 237/475] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:57 2022] POST /identity/v3/users => generated 248 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:57:58.363422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4be29-1394-4adc-90ee-80f3f91707ad None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:58.397644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:58.406565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:58.407181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:58.407466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:58.413080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:58.413080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:58.413080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:58.413080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:58.422896 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 239/476] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:58.429628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7c1c5-9ade-416b-9919-e32de5781ce6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:58.443958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:58.564356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53657635-6b0f-4d97-a250-3764900e7b56 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:58.617468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7c1c5-9ade-416b-9919-e32de5781ce6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:58.627622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:58.646599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:58.647584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:58.649143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:58.649617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:58.651189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:58.653592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:58.666809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961eb2d-dc0b-4c56-96cd-44829d3aa7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:58.667837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961eb2d-dc0b-4c56-96cd-44829d3aa7b0 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:58.668313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961eb2d-dc0b-4c56-96cd-44829d3aa7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:58.668816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961eb2d-dc0b-4c56-96cd-44829d3aa7b0 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:58.669840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961eb2d-dc0b-4c56-96cd-44829d3aa7b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:58.671564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961eb2d-dc0b-4c56-96cd-44829d3aa7b0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:58.703086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.sql.core [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 18:57:58.703086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 18:57:58.703086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [parameters: {'id': '9cd7f49b318b44d693cf43222ea33acf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 18:57:58.703086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81883) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application conn.query(q) Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result.read() Aug 29 18:57:58.721285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 18:57:58.722340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application next(self.gen) Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application yield resource Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application next(self.gen) Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise self.value Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application session.commit() Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 18:57:58.723215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.session.flush() Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application compat.raise_( Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 18:57:58.724082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 18:57:58.724958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application conn.query(q) Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result.read() Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 18:57:58.727483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [parameters: {'id': '9cd7f49b318b44d693cf43222ea33acf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:58.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 18:57:58.731565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:58.733547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 240/477] 10.222.0.82 () {60 vars in 1131 bytes} [Mon Aug 29 18:57:58 2022] POST /identity/v3/roles => generated 144 bytes in 282 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:58.733547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:58.790278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:57:58.807200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 238/478] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:57:58 2022] POST /identity/v3/users => generated 249 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:57:58.855339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4eb3d-b194-478f-82b3-a3e79020e7a2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:58.905757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd54ee9-1527-463c-90a0-70846b4fc4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:58.906713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54ee9-1527-463c-90a0-70846b4fc4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:58.908242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54ee9-1527-463c-90a0-70846b4fc4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:58.909122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd54ee9-1527-463c-90a0-70846b4fc4e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:58.926495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd54ee9-1527-463c-90a0-70846b4fc4e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ccd54ee9-1527-463c-90a0-70846b4fc4e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:57:58.932378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:57:58.933309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 18:57:58.934097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:57:58.936118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 241/479] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:57:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:57:58.942714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961eb2d-dc0b-4c56-96cd-44829d3aa7b0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:57:59.063641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961eb2d-dc0b-4c56-96cd-44829d3aa7b0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:57:59.105542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe86cf-f0b1-4fb3-8334-caaeb3a093a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:57:59.106400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe86cf-f0b1-4fb3-8334-caaeb3a093a2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:59.106829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe86cf-f0b1-4fb3-8334-caaeb3a093a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:59.107292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe86cf-f0b1-4fb3-8334-caaeb3a093a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:59.108338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe86cf-f0b1-4fb3-8334-caaeb3a093a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:57:59.108792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe86cf-f0b1-4fb3-8334-caaeb3a093a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:57:59.110303 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe86cf-f0b1-4fb3-8334-caaeb3a093a2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:57:59.120161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 239/480] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:57:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:57:59.912352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634428e0-4960-4e0c-9120-0d2b207869c9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:59.913350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634428e0-4960-4e0c-9120-0d2b207869c9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:59.913887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634428e0-4960-4e0c-9120-0d2b207869c9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:59.915860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 242/481] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:57:59.921579 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f42dd-d9e5-420a-94e7-b94246114f6e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:57:59.922421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f42dd-d9e5-420a-94e7-b94246114f6e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:57:59.922904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f42dd-d9e5-420a-94e7-b94246114f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:57:59.958597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-468f42dd-d9e5-420a-94e7-b94246114f6e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:57:59.960179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-468f42dd-d9e5-420a-94e7-b94246114f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:57:59.964075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:00.078037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 240/482] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:00.436809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634428e0-4960-4e0c-9120-0d2b207869c9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:00.501585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb1c9-92f0-4210-83fe-ebdaef18eafb None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:00.502551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb1c9-92f0-4210-83fe-ebdaef18eafb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:00.502763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb1c9-92f0-4210-83fe-ebdaef18eafb None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:00.507852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 241/483] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:00.529858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22ffbb-c636-43a0-b1c5-c63e57749cd3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:00.530456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22ffbb-c636-43a0-b1c5-c63e57749cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:00.530949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22ffbb-c636-43a0-b1c5-c63e57749cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:00.575565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4a22ffbb-c636-43a0-b1c5-c63e57749cd3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:00.577363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4a22ffbb-c636-43a0-b1c5-c63e57749cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:00.580402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634428e0-4960-4e0c-9120-0d2b207869c9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:00.599562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:00.650558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8177-4ecd-4088-9b90-50f8e5399326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:00.650558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8177-4ecd-4088-9b90-50f8e5399326 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:00.650558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8177-4ecd-4088-9b90-50f8e5399326 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:00.650558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8177-4ecd-4088-9b90-50f8e5399326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:00.676889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb8177-4ecd-4088-9b90-50f8e5399326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4ebb8177-4ecd-4088-9b90-50f8e5399326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:00.682897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:00.684033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:00.685292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:00.688019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 243/484] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:00.695134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8177-4ecd-4088-9b90-50f8e5399326 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:00.722463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 242/485] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:00.822808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8177-4ecd-4088-9b90-50f8e5399326 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:00.849204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010537-c117-42e1-bbb7-4d849a03ac52 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:00.849514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010537-c117-42e1-bbb7-4d849a03ac52 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:00.849761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89010537-c117-42e1-bbb7-4d849a03ac52 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:00.852486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 243/486] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:00.856748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818928ba-ee75-4fe7-8525-67ad9fefdf3f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:00.857035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818928ba-ee75-4fe7-8525-67ad9fefdf3f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:00.857312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818928ba-ee75-4fe7-8525-67ad9fefdf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:00.881292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:00.881904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:00.882179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:00.882447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:00.883116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:00.883416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:00.884821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:00.892172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-818928ba-ee75-4fe7-8525-67ad9fefdf3f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:00.893982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-818928ba-ee75-4fe7-8525-67ad9fefdf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:00.909269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 244/487] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:00.916183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:00.983266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:01.040357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:01.053991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 244/488] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:01.053991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818928ba-ee75-4fe7-8525-67ad9fefdf3f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.093699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9001d20-acee-4f50-96a3-7286375606e2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.134018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.134018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.134018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.134018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.143330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:01.144932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:01.160789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:01.161740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:01.162616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:01.162616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:01.162616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:01.162616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 245/489] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:01.168549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.249065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818928ba-ee75-4fe7-8525-67ad9fefdf3f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.272506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:01.285220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3e4b3-7d79-4ace-8583-8b7c42bc923b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.322737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7fe28-2a4e-4b28-8f11-862b3f7f79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.323378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7fe28-2a4e-4b28-8f11-862b3f7f79a5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.325071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7fe28-2a4e-4b28-8f11-862b3f7f79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.325351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7fe28-2a4e-4b28-8f11-862b3f7f79a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.348466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4849be-7cdc-417b-97aa-97f9903cf9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.349518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7fe28-2a4e-4b28-8f11-862b3f7f79a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:01.354258 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4849be-7cdc-417b-97aa-97f9903cf9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.354553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4849be-7cdc-417b-97aa-97f9903cf9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.354877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4849be-7cdc-417b-97aa-97f9903cf9f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.355555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4849be-7cdc-417b-97aa-97f9903cf9f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:01.355951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4849be-7cdc-417b-97aa-97f9903cf9f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:01.357306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4849be-7cdc-417b-97aa-97f9903cf9f4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-26f7fe28-2a4e-4b28-8f11-862b3f7f79a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:01.359193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:01.360108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:01.362911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 245/490] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:01.366738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7fe28-2a4e-4b28-8f11-862b3f7f79a5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.383229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 246/491] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:01.383229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9096b-9997-4baa-97b3-37b8e7b0ae96 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.383682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9096b-9997-4baa-97b3-37b8e7b0ae96 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.383682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9096b-9997-4baa-97b3-37b8e7b0ae96 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.386388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 247/492] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:01.390495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9096b-9997-4baa-97b3-37b8e7b0ae96 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.443715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:01.490857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7fe28-2a4e-4b28-8f11-862b3f7f79a5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.524720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9096b-9997-4baa-97b3-37b8e7b0ae96 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.527639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4f468-f480-4364-93b0-533a05d263a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.528337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f468-f480-4364-93b0-533a05d263a4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.528622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f468-f480-4364-93b0-533a05d263a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.528894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4f468-f480-4364-93b0-533a05d263a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.529555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f468-f480-4364-93b0-533a05d263a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:01.529855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f468-f480-4364-93b0-533a05d263a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:01.531208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d4f468-f480-4364-93b0-533a05d263a4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:01.544034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 246/493] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:01.544034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494263cc-f77e-434c-830a-a72e0d237031 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.544034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494263cc-f77e-434c-830a-a72e0d237031 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.544034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494263cc-f77e-434c-830a-a72e0d237031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.560464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-494263cc-f77e-434c-830a-a72e0d237031 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:01.561744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-494263cc-f77e-434c-830a-a72e0d237031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:01.565313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.565951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.566229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.566567 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.574221 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:01.575695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:01.589618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:01.590531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:01.591527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 248/494] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:01.592720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.598230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:01.649104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 247/495] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:01.649857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494263cc-f77e-434c-830a-a72e0d237031 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.701623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d4ade-9e46-46b8-80e5-978a33e2cde7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.707214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:01.735241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ad3c-1bdf-445e-8fbe-f4137cd35051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.735899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ad3c-1bdf-445e-8fbe-f4137cd35051 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.736780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ad3c-1bdf-445e-8fbe-f4137cd35051 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.737051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ad3c-1bdf-445e-8fbe-f4137cd35051 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.748817 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75ad3c-1bdf-445e-8fbe-f4137cd35051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4b75ad3c-1bdf-445e-8fbe-f4137cd35051 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:01.756252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:01.757381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:01.758195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 249/496] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:01.758854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ad3c-1bdf-445e-8fbe-f4137cd35051 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.769382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494263cc-f77e-434c-830a-a72e0d237031 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.805082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2056a-fe11-4035-81bf-754aadbe9f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.805718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2056a-fe11-4035-81bf-754aadbe9f74 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.805994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2056a-fe11-4035-81bf-754aadbe9f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.806262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2056a-fe11-4035-81bf-754aadbe9f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.816749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2056a-fe11-4035-81bf-754aadbe9f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:01.818199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2056a-fe11-4035-81bf-754aadbe9f74 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:01.827054 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5ee2056a-fe11-4035-81bf-754aadbe9f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:01.835024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:01.838789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 248/497] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10f4e-0af5-4ad8-9014-0a29e534032f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10f4e-0af5-4ad8-9014-0a29e534032f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b10f4e-0af5-4ad8-9014-0a29e534032f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 249/498] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:01.844067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b10f4e-0af5-4ad8-9014-0a29e534032f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.873849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ad3c-1bdf-445e-8fbe-f4137cd35051 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.910392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.910918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.911238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.911465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.912363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:01.912602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:01.914016 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:01.950955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 250/499] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:01.951830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:01.961900 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b10f4e-0af5-4ad8-9014-0a29e534032f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:01.963399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:01.996326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd31ac-9e4d-40d7-bd7d-edb283db5bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:01.996930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd31ac-9e4d-40d7-bd7d-edb283db5bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:01.997212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd31ac-9e4d-40d7-bd7d-edb283db5bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:01.997489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd31ac-9e4d-40d7-bd7d-edb283db5bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:01.998150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd31ac-9e4d-40d7-bd7d-edb283db5bd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:01.998455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd31ac-9e4d-40d7-bd7d-edb283db5bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:01.999850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd31ac-9e4d-40d7-bd7d-edb283db5bd1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.008639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 250/500] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:02.009812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e325-bdcf-4e11-aea6-85948cea9945 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.010100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e325-bdcf-4e11-aea6-85948cea9945 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.010378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31e325-bdcf-4e11-aea6-85948cea9945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.029688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4a31e325-bdcf-4e11-aea6-85948cea9945 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:02.031252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4a31e325-bdcf-4e11-aea6-85948cea9945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:02.055852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69457f-98a4-4c6a-aa2b-8e7a1ac3b40e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.078713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:02.091005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.091620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.091932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.092215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.092899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:02.093213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.094585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.100709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 251/501] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:02.104619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e325-bdcf-4e11-aea6-85948cea9945 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.110550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 251/502] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:02.110550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.200141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:02.211464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a31e325-bdcf-4e11-aea6-85948cea9945 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.229061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d3dee-81ac-4372-8503-5069763e334f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.251455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb649de-a67b-40ca-9beb-7dd20ef9721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.252964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb649de-a67b-40ca-9beb-7dd20ef9721f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.253247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb649de-a67b-40ca-9beb-7dd20ef9721f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.253527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb649de-a67b-40ca-9beb-7dd20ef9721f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.263698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb649de-a67b-40ca-9beb-7dd20ef9721f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:02.265460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7d11-73d2-467f-a12a-7473603c44ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.266064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7d11-73d2-467f-a12a-7473603c44ed None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.266343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7d11-73d2-467f-a12a-7473603c44ed None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.266615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c7d11-73d2-467f-a12a-7473603c44ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bbb649de-a67b-40ca-9beb-7dd20ef9721f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:02.268909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:02.269817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:02.270625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 252/503] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:02.271295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb649de-a67b-40ca-9beb-7dd20ef9721f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.327000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:02.350005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7d11-73d2-467f-a12a-7473603c44ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.351578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c7d11-73d2-467f-a12a-7473603c44ed None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.385645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb649de-a67b-40ca-9beb-7dd20ef9721f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.419619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.422065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.422065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.422065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.431367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.432839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:02.447576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:02.451190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:02.452453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:02.452453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:02.452453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:02.452453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 253/504] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:02.452453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.458672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:02.458815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 252/505] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:02.459599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7d11-73d2-467f-a12a-7473603c44ed None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.542886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:02.549279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988f39f-3b07-41eb-ac59-01700a8d958b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.560511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c7d11-73d2-467f-a12a-7473603c44ed None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.583851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.584480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.584764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.585036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.592301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.593724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.595416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.596198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.596482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.596756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.597413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:02.597723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.599077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.609540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 253/506] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:02.610780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:02.612578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 18:58:02.613458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:02.613953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.614021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 254/507] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:02.616463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.685053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:02.721312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b0a77-f573-4647-b811-f833fa64c41a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.721506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e88c24-780f-4286-916b-a26da1ba8993 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.756103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.756551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.756690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.756973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.757175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.757267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.757460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.757740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.757864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:02.758164 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.759519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.769606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.771043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.771323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 255/508] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:02.772157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.778288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:02.790549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:02.791581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:02.792465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:02.792465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:02.792465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:02.792465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 254/509] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:02.792465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.877452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad3851-c965-4e37-b87b-9b5aaedeaeb3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.892826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17271d-d8f1-4742-b55f-f95c770ce06c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:02.902888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:02.911667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.912383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.912674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.916537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.922772 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.925230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.927819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:02.928453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:02.928734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:02.929007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:02.940856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:02.942061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:02.943842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:02.943842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:02.943842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:02.944094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:02.944184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 256/510] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:02.944253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:02.944318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:02.958215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:02.959544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:02.960821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:02.960821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:02.960821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:02.960821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 255/511] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:02.960821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.010579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.050742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2372-9638-4426-b198-32458d62d245 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.061537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e158ae9-fa13-4c5f-91e2-18cc26ed0db1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.084777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.085383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.085664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.085940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.086665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:03.086971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.088554 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.094722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.095912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.096280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.096578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.104157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.105742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:03.117531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:03.118424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:03.119301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 256/512] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:03.120378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.126405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 257/513] 10.222.0.82 () {56 vars in 1137 bytes} [Mon Aug 29 18:58:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:03.127811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.162935 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.226109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3aef0-745b-4718-90cc-4aac47bbc8c5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.228179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a43fa2-4eda-4768-8b0c-969f28eb3ec6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.234929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.261940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.262452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.262736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.263013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.263656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:03.263868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.264049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.264617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.264984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.265341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.265495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.266143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:03.266582 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.268798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.278580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 257/514] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:03.279380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.281964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 258/515] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:03.281964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.377991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.383493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ac898-f6c1-410b-8bc9-3216027b307a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.384195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484814f4-4b44-4b5e-9a4d-111749e95209 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.417048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.417659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.417950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.418231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.418960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:03.419270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.419371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.419955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.420237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.420510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.420729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.421151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:03.421510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.422859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.439784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 258/516] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:03.439784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.440061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 259/517] 10.222.0.82 () {56 vars in 1137 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:03.440272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.466550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.538222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab18458-7dbb-4cc0-980f-ccc7d0d6ab78 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.539604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87516b1-3c75-486b-8386-4e00876453f5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.572836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f4a5-2d1a-43b6-9309-53d91b419b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.573447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f4a5-2d1a-43b6-9309-53d91b419b8a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.573759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f4a5-2d1a-43b6-9309-53d91b419b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.574035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0f4a5-2d1a-43b6-9309-53d91b419b8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.575022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677a15-359d-4d98-873a-519a15467e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.575626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677a15-359d-4d98-873a-519a15467e52 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.575942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677a15-359d-4d98-873a-519a15467e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.576220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677a15-359d-4d98-873a-519a15467e52 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.576866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677a15-359d-4d98-873a-519a15467e52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.578285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677a15-359d-4d98-873a-519a15467e52 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.645363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0f4a5-2d1a-43b6-9309-53d91b419b8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.646869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0f4a5-2d1a-43b6-9309-53d91b419b8a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.650895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 260/518] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:58:03 2022] POST /identity/v3/users => generated 247 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:03.651720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677a15-359d-4d98-873a-519a15467e52 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.666468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.682673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.771187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677a15-359d-4d98-873a-519a15467e52 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.772905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 259/519] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:03.773947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f4a5-2d1a-43b6-9309-53d91b419b8a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.817941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.819314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.820093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.820885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.828497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.831151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:03.844432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:03.845420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:03.846336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 261/520] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:03.847765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:03.891779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0f4a5-2d1a-43b6-9309-53d91b419b8a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.920427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.921547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:03.930510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:03.931366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:03.931648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:03.931950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:03.940738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:03.942211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:03.953385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d61ae-d34f-49ab-93c7-a0535ecf1811 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:03.953640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:03.954506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:03.956679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 260/521] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:03.957417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.000538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0dd18-ffa6-4922-ab3d-2d2b2b20f378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.001181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dd18-ffa6-4922-ab3d-2d2b2b20f378 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.001470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dd18-ffa6-4922-ab3d-2d2b2b20f378 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.002367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0dd18-ffa6-4922-ab3d-2d2b2b20f378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.084240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218a358-2860-4e5b-aba9-5119c4a416ad None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:04.088106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0dd18-ffa6-4922-ab3d-2d2b2b20f378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.089554 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0dd18-ffa6-4922-ab3d-2d2b2b20f378 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.124521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.125271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.125552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.125836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.137925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.139948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:04.156447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:04.157586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:04.159126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:04.159126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:04.159126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:04.159126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 261/522] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:04.159126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.173152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:04.207064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:04.214996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 262/523] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:04.214996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0dd18-ffa6-4922-ab3d-2d2b2b20f378 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.277387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2682b-b78d-45f5-bac1-8413d27a5061 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:04.312983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.313587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.313861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.314728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.315505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:04.315857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.317318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.330781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0dd18-ffa6-4922-ab3d-2d2b2b20f378 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:04.343028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 262/524] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:04.343028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.373856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.374485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.374742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.375012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.375756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:04.376077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.377771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.395856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 263/525] 10.222.0.82 () {56 vars in 1139 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:04.397642 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.428342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:04.467001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:04.474171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ecb91-8f39-496f-acbf-cb337cea40d8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:04.504903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0505a0-837e-4fc0-9714-a8b454b672a5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:04.512012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.512634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.512924 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.513305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.513957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:04.514265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.515628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.528573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 263/526] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:04.529388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.547962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.548716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.549238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.549550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.560272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.561744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:04.578731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:04.580342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:04.581720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:04.581720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:04.581720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:04.581720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 264/527] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:04.582062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.640940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745b4d7-6799-4ed0-a92d-1a7d25778854 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:04.669351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:04.676877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.678627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.678627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.678919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.679827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=e02a03585caf46fdb09b4a2fdde91a51) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:04.680146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.681615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.687789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 264/528] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/role_assignments?user.id=e02a03585caf46fdb09b4a2fdde91a51&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:04.688592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.701074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a0e36-e4b1-4064-96f0-9e0a4552d255 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:04.730859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:04.754434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e698-d109-41c6-abc8-42e9e8a4aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.755531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e698-d109-41c6-abc8-42e9e8a4aa9f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.756042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e698-d109-41c6-abc8-42e9e8a4aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.756571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427e698-d109-41c6-abc8-42e9e8a4aa9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.825570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe613c-f04d-4404-ab81-c88be6b29f60 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:04.841066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e698-d109-41c6-abc8-42e9e8a4aa9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.843115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427e698-d109-41c6-abc8-42e9e8a4aa9f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.866657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:04.867305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:04.867590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:04.867903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:04.875664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:04.877648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:04.890496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:04.891411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:04.892853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 265/529] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:04.893774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.938020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:04.960410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 265/530] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:04.961674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e698-d109-41c6-abc8-42e9e8a4aa9f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:04.988594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:05.005952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a4c2f-6f13-427c-85d5-51d278093aa5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.043530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.044244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.044527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.044802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.045460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:05.045765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.047279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.061617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 266/531] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:05.062937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:05.077096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427e698-d109-41c6-abc8-42e9e8a4aa9f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.114901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.115996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.116508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.116992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.117986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:05.118505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.120266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.140712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 266/532] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:05.141982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:05.177358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc81a-dfb6-4dbd-9092-e11fd4bde100 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.192341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:05.227565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.228389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.228677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.228948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.247227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.249761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.254471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:05.265258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea470b0-fcc5-454e-8329-1ffc432ea172 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:05.273693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:05.274611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:05.275632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:05.275632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:05.275632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:05.277151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 267/533] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:05.277790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:05.311144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.312443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.312993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.313669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.323666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.326367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:05.343084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:05.344019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:05.344880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:05.344880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:05.344880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:05.344880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:05.344880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:05.344880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:05.344880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:05.344880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:05.352070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 267/534] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:05.353165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:05.390717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31980bb9-f536-40db-baff-265a5fe493a3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.426280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.426961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.427363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.427766 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.428619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=5786ad6388c54a3f82955e12e8e8f8b3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:05.429037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.430746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.436622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 268/535] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:05 2022] GET /identity/v3/role_assignments?user.id=5786ad6388c54a3f82955e12e8e8f8b3&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:05.437595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:05.468531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:05.473143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5139b3-197c-4d74-ad44-1e23a08afd7f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.505484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:05.512949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.513743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.514212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.514631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.515451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:05.515925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.518084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.532048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 268/536] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:05.539961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:05.552827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27ce08-ad2b-4183-b6d4-2507f34a991e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.590543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.591250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.591610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.591995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.592787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:05.593168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.594686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.619759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 269/537] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:05.628497 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:05.685949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba865b-4ad9-4f55-b9e9-6e7b2bd03424 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.725278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57e727-d651-442b-b3a1-b6e250b7f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.726329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57e727-d651-442b-b3a1-b6e250b7f2ad None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.726818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57e727-d651-442b-b3a1-b6e250b7f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.727297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57e727-d651-442b-b3a1-b6e250b7f2ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.735097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57e727-d651-442b-b3a1-b6e250b7f2ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.737102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57e727-d651-442b-b3a1-b6e250b7f2ad None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3b57e727-d651-442b-b3a1-b6e250b7f2ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:05.749448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:05.750329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:05.751167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:05.751167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:05.751167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:05.751167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:05.751167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:05.751167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:05.751167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:05.751167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:05.753785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 269/538] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:05.759573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b9fd8-4664-4f75-ae89-2935b30164c5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.760177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b9fd8-4664-4f75-ae89-2935b30164c5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.760680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b9fd8-4664-4f75-ae89-2935b30164c5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.762199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 270/539] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:05.763168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b9fd8-4664-4f75-ae89-2935b30164c5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:05.790952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb232efc-16dd-4996-92d4-35fe677c59cb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.792599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:05.821041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:05.832443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bf914-288e-42cd-9c4e-72cb25b33ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.833323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf914-288e-42cd-9c4e-72cb25b33ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.833755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf914-288e-42cd-9c4e-72cb25b33ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.834287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bf914-288e-42cd-9c4e-72cb25b33ac3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.835175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bf914-288e-42cd-9c4e-72cb25b33ac3 None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=1b55bbe406a04cf28244380f5b07eed9) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:05.836173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bf914-288e-42cd-9c4e-72cb25b33ac3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.838062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bf914-288e-42cd-9c4e-72cb25b33ac3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:05.847834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 270/540] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:05 2022] GET /identity/v3/role_assignments?user.id=1b55bbe406a04cf28244380f5b07eed9&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:05.850244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2591-4a5a-40b4-8c9c-0a3bbf727659 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.850726 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2591-4a5a-40b4-8c9c-0a3bbf727659 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.851175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2591-4a5a-40b4-8c9c-0a3bbf727659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.888888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-962a2591-4a5a-40b4-8c9c-0a3bbf727659 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:05.890299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-962a2591-4a5a-40b4-8c9c-0a3bbf727659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:05.913840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b9fd8-4664-4f75-ae89-2935b30164c5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:05.988419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:05.989097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:05.989384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:05.989663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:05.990374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:05.990987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:05.993430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:06.017800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 271/541] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:06.024137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:06.030395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 271/542] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:06.125387 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:06.145000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5890d9-90ca-4240-bcaa-0413adfff453 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:06.185820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:06.186427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:06.186706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:06.186976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:06.187789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=218e551387574808b225e73b766b5062) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:06.188105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:06.189759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:06.199889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 272/543] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:06 2022] GET /identity/v3/role_assignments?user.id=218e551387574808b225e73b766b5062&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:06.430787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a2591-4a5a-40b4-8c9c-0a3bbf727659 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:06.546293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a2591-4a5a-40b4-8c9c-0a3bbf727659 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:06.567238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:06.590946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923823d-7d7c-428b-a008-5bca082ddadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:06.591587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923823d-7d7c-428b-a008-5bca082ddadf None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:06.591910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923823d-7d7c-428b-a008-5bca082ddadf None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:06.592189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923823d-7d7c-428b-a008-5bca082ddadf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:06.604171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923823d-7d7c-428b-a008-5bca082ddadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c923823d-7d7c-428b-a008-5bca082ddadf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:06.609035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:06.609944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:06.610746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 272/544] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:06.616960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:06.738889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b03d7-fcf9-4319-91af-b43b93ac0189 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:06.778974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:06.779649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:06.779955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:06.780233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:06.780906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:06.781214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:06.783226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:06.795840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 273/545] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:06.800800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923823d-7d7c-428b-a008-5bca082ddadf None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:06.944326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923823d-7d7c-428b-a008-5bca082ddadf None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:06.980178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429a2e8-b4b3-4582-a5ed-64552339c35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:06.980814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429a2e8-b4b3-4582-a5ed-64552339c35c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:06.981097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429a2e8-b4b3-4582-a5ed-64552339c35c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:06.981371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429a2e8-b4b3-4582-a5ed-64552339c35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:06.992343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429a2e8-b4b3-4582-a5ed-64552339c35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:06.993761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429a2e8-b4b3-4582-a5ed-64552339c35c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4429a2e8-b4b3-4582-a5ed-64552339c35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:07.008761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:07.009704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:07.010627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:07.010627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:07.010627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:07.010627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 273/546] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:07.015679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:07.028841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:07.032236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06d28b-cb75-4743-80dc-2880a9b837d5 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:07.032524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06d28b-cb75-4743-80dc-2880a9b837d5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:07.033402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b06d28b-cb75-4743-80dc-2880a9b837d5 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:07.035114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 274/547] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:07.040084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e024c-dce7-41ed-8858-e24d53f2f3e2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:07.048072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e024c-dce7-41ed-8858-e24d53f2f3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:07.048072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e024c-dce7-41ed-8858-e24d53f2f3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:07.072738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f15e024c-dce7-41ed-8858-e24d53f2f3e2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:07.074039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f15e024c-dce7-41ed-8858-e24d53f2f3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:07.114888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:07.148544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8928221a-b381-4a6c-a6bd-ea754074b0d2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:07.188181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:07.188797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:07.189693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:07.189971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:07.190618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:07.190922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:07.195749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:07.209574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 274/548] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:07.211169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:07.257684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 275/549] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:58:07.284799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:07.321574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50863400-b92a-4ace-a8be-c5c63e0ee58e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:07.357479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:07.358108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:07.358389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:07.358660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:07.365951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:07.367575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:07.379575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:07.380773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:07.381781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:07.385597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 275/550] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:07.386927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e024c-dce7-41ed-8858-e24d53f2f3e2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:07.512403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e024c-dce7-41ed-8858-e24d53f2f3e2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:07.565953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:07.567050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:07.567541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:07.568061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:07.569092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:07.569629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:07.571396 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:07.571947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:07.591139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 276/551] 10.222.0.82 () {56 vars in 1135 bytes} [Mon Aug 29 18:58:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:07.608943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:07.634791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:07.691483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef7e74-bd2a-43b7-8371-88dae2dff3c2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:07.724242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:07.740292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c8bb6-1172-417b-a899-47d04dc6f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:07.741549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8bb6-1172-417b-a899-47d04dc6f402 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:07.741999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8bb6-1172-417b-a899-47d04dc6f402 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:07.745851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c8bb6-1172-417b-a899-47d04dc6f402 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:07.762160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c8bb6-1172-417b-a899-47d04dc6f402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:07.762545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1146a26-4cb2-496c-a4b0-143d43e281c8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ad7c8bb6-1172-417b-a899-47d04dc6f402 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:07.776649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:07.777607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:07.778409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:07.783811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 276/552] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:07.789459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c8bb6-1172-417b-a899-47d04dc6f402 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:07.808717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13d8a-545f-46a0-938c-02740cc83fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:07.809337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13d8a-545f-46a0-938c-02740cc83fdc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:07.809621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13d8a-545f-46a0-938c-02740cc83fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:07.809894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc13d8a-545f-46a0-938c-02740cc83fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:07.942579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13d8a-545f-46a0-938c-02740cc83fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:07.944062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc13d8a-545f-46a0-938c-02740cc83fdc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:07.960138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:08.003753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c8bb6-1172-417b-a899-47d04dc6f402 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.051798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 277/553] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 18:58:08.061375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13d8a-545f-46a0-938c-02740cc83fdc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.081338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.082029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.082320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.082598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.083279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:08.083587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:08.084988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:08.105042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 277/554] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:08.113410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.183918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc13d8a-545f-46a0-938c-02740cc83fdc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.195680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:08.202158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:08.227112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584bcea-9ff1-45f4-92d7-6d327d3b40d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.227831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584bcea-9ff1-45f4-92d7-6d327d3b40d0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.228121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584bcea-9ff1-45f4-92d7-6d327d3b40d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.228400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584bcea-9ff1-45f4-92d7-6d327d3b40d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.239624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584bcea-9ff1-45f4-92d7-6d327d3b40d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:08.241613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584bcea-9ff1-45f4-92d7-6d327d3b40d0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:08.254226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792e1e3-7188-44ae-b7e9-7bc171b31edb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3584bcea-9ff1-45f4-92d7-6d327d3b40d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:08.259009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:08.259936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 278/555] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d2aa6-de1a-44bd-8195-296ecc12df0a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d2aa6-de1a-44bd-8195-296ecc12df0a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d2aa6-de1a-44bd-8195-296ecc12df0a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 279/556] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:08.265720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f3e-edab-4edb-a284-2ee32321c3f2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.266224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f3e-edab-4edb-a284-2ee32321c3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.266224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f3e-edab-4edb-a284-2ee32321c3f2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.267825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 280/557] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:08.268287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62f3e-edab-4edb-a284-2ee32321c3f2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.301607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf043b3-85a4-426a-a675-c09d842fed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.302307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf043b3-85a4-426a-a675-c09d842fed2b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.302535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf043b3-85a4-426a-a675-c09d842fed2b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.302823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf043b3-85a4-426a-a675-c09d842fed2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.313807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf043b3-85a4-426a-a675-c09d842fed2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:08.316275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf043b3-85a4-426a-a675-c09d842fed2b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-aaf043b3-85a4-426a-a675-c09d842fed2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:08.331876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:08.333333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:08.334218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:08.334218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:08.334218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:08.334218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 278/558] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:08.334849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0de3a-c296-41fe-952a-43fefc5d5055 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.334849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0de3a-c296-41fe-952a-43fefc5d5055 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.335017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0de3a-c296-41fe-952a-43fefc5d5055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.353955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-62d0de3a-c296-41fe-952a-43fefc5d5055 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:08.354360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-62d0de3a-c296-41fe-952a-43fefc5d5055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:08.381745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb62f3e-edab-4edb-a284-2ee32321c3f2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.417587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.418192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.418502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.418832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.419476 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:08.419803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:08.421155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:08.423359 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 279/559] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:08.429265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990db2-cbf1-4700-9ba2-8239ee75da1a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.429555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990db2-cbf1-4700-9ba2-8239ee75da1a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.429828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9990db2-cbf1-4700-9ba2-8239ee75da1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.441823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 281/560] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:08.441823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.471504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:08.484866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e9990db2-cbf1-4700-9ba2-8239ee75da1a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:08.486715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e9990db2-cbf1-4700-9ba2-8239ee75da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:08.512908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:08.565768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54836b6c-3061-440c-bb96-430e2031fb4f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.566693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 280/561] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:08.567945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9990db2-cbf1-4700-9ba2-8239ee75da1a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.605770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.606443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.606722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.606990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.611750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:08.611750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:08.611750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:08.628201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 282/562] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:08.630078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.725599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9990db2-cbf1-4700-9ba2-8239ee75da1a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.731395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:08.748603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970aea1-de24-4545-89b6-7f6ed714440c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.761874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082fec6-f2db-4fc1-ac88-f46220f4c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.762648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082fec6-f2db-4fc1-ac88-f46220f4c0ff None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.763021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082fec6-f2db-4fc1-ac88-f46220f4c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.763279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082fec6-f2db-4fc1-ac88-f46220f4c0ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.770518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082fec6-f2db-4fc1-ac88-f46220f4c0ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:08.771998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082fec6-f2db-4fc1-ac88-f46220f4c0ff None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-9082fec6-f2db-4fc1-ac88-f46220f4c0ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:08.784646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:08.785541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:08.786464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 281/563] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:08.787027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b099f97-52f8-4d11-b6b8-bf932240f094 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.787420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b099f97-52f8-4d11-b6b8-bf932240f094 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.787515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b099f97-52f8-4d11-b6b8-bf932240f094 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.788764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 282/564] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:08.793114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b099f97-52f8-4d11-b6b8-bf932240f094 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.797652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.798315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.798599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.798876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.806698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:08.808514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:08.816960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:08.822142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:08.823062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:08.824032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:08.826069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 283/565] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:08.826988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.906048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b099f97-52f8-4d11-b6b8-bf932240f094 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.934931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bbcd2-ce21-4e59-9f00-f6e64414fd24 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:08.941544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897d8be-665e-4a89-9199-4398e5f4ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.942589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d8be-665e-4a89-9199-4398e5f4ab8d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.942875 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d8be-665e-4a89-9199-4398e5f4ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.943154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897d8be-665e-4a89-9199-4398e5f4ab8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.955935 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0897d8be-665e-4a89-9199-4398e5f4ab8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-0897d8be-665e-4a89-9199-4398e5f4ab8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:08.960761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:08.961971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:08.962809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 283/566] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:08.963487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdd9e3-4c5a-40fb-aed6-220ae477eea6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.963584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdd9e3-4c5a-40fb-aed6-220ae477eea6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.963888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdd9e3-4c5a-40fb-aed6-220ae477eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.972576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:08.973191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:08.973477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:08.973753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:08.974460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:08.974771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:08.976233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:08.982341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-aebdd9e3-4c5a-40fb-aed6-220ae477eea6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:08.983537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aebdd9e3-4c5a-40fb-aed6-220ae477eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:08.988451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 284/567] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:08.989254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:08.999709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.051087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 284/568] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:09.052039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdd9e3-4c5a-40fb-aed6-220ae477eea6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.076591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.093567 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c6c8a-2768-4dd4-b8b7-7b7aabd2767c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.133070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.133675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.133954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.134229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.134957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:09.135262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:09.136697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:09.155033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 285/569] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:58:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:09.156636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.174282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdd9e3-4c5a-40fb-aed6-220ae477eea6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.210455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c0e9a-d4de-4a7e-8987-bd6e5f4d4cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.211426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0e9a-d4de-4a7e-8987-bd6e5f4d4cfa None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.211426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0e9a-d4de-4a7e-8987-bd6e5f4d4cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.211653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0e9a-d4de-4a7e-8987-bd6e5f4d4cfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.224399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c0e9a-d4de-4a7e-8987-bd6e5f4d4cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:09.228805 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-249c0e9a-d4de-4a7e-8987-bd6e5f4d4cfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:09.230094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:09.231021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 285/570] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:09.231888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c0e9a-d4de-4a7e-8987-bd6e5f4d4cfa None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.273891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0b1ba-4077-4bbe-99e3-e271c7f5d4db None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.310884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.311496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.311811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.312095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.312419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.312856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:09.313053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:09.315145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:09.323589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 286/571] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:09.324429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.346914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c0e9a-d4de-4a7e-8987-bd6e5f4d4cfa None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.381660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.382269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.382552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.382828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.383548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=209e9c8c1a0b41b58f51e94e4bd6c3ff) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:09.383889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:09.385348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:09.390533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 286/572] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/role_assignments?user.id=209e9c8c1a0b41b58f51e94e4bd6c3ff&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:09.391294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.436469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45635c9-a350-4b74-a9aa-2c785b040041 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.470003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.480566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.481250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.481537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.481821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.497781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:09.499765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:09.512908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b070f88-8e27-42fb-8622-0c6476f583d0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:09.515963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:09.517756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:09.518815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:09.518815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:09.518815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:09.518815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 287/573] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:09.519049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.560055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.560696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.560982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.561260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.561929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:09.562238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:09.563611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:09.565528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.574100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 287/574] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:09.584649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.640108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b2795-61cd-436a-82a1-d362df52d1a4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.681143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3afcb-2e8f-43ec-9ce2-538638f6424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.681891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3afcb-2e8f-43ec-9ce2-538638f6424d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.682243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3afcb-2e8f-43ec-9ce2-538638f6424d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.682590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3afcb-2e8f-43ec-9ce2-538638f6424d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.682774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e74a9-0789-4293-9ff9-150d37386fca None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.697576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3afcb-2e8f-43ec-9ce2-538638f6424d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7ac3afcb-2e8f-43ec-9ce2-538638f6424d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:09.705956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:09.707188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 288/575] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:09.708311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3afcb-2e8f-43ec-9ce2-538638f6424d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.727150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.727909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.728262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.728601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.742757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:09.744304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:09.750397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:09.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:09.764170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:09.765062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:09.765062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:09.765062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:09.765062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 288/576] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:09.765062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.821599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3afcb-2e8f-43ec-9ce2-538638f6424d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.829826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.859086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.859895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.860281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.860661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.861982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:09.862391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:09.863933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:09.880155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 289/577] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:09.880155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.889189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04192fd-a8e8-46e9-b681-96249f033bc8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:09.932984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:09.933631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:09.934489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:09.934839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:09.948817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:09.950404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:09.967140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:09.968343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:09.969381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:09.969381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:09.969381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:09.972153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 289/578] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:09.973088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:09.991403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:09.995897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568ce23-be59-424f-a723-e29502bf76fb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.035138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.035773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.036050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.036323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.036995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:10.037297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.038649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.052761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 290/579] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:10.053662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.081344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:10.084356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1521e0-7dbc-4ef3-b9d7-5742465f7f21 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.121351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.121963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.122240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.122509 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.123152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:10.123457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.124843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.146425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 290/580] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:10.147509 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.183119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053367b6-8fee-4a78-b13b-f3636e5778d0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.223616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.224298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.224584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.224859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.231432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.232925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:10.245120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:10.246027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 291/581] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:10.247029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.267473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b3b0-0b39-4b75-9b1c-1a831dcc8128 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.270147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:10.304350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.304963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.305247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.305522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.306168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:10.306481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.307885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.323841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 291/582] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:10.323841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.343756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:10.362978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7e740-3f7c-41d0-8cf5-12f765008491 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.401320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.402126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.402514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.402891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.414294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.416177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.430873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366403a-00f0-4cef-8de8-ae8ea57136c5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:10.432774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:10.433760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:10.434660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:10.434660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:10.434660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:10.434660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 292/583] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:10.434660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.474325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.475124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.475498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.475964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.483844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.485275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:10.497333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:10.498522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 292/584] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:10.499454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.520035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:10.554903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0075-4edf-4ada-b456-fd045a229c20 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.590318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:10.597975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.598679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.598966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.599243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.600062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:10.600506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.602007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.612428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28734-c974-4f24-922c-708ed30b8583 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.620197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 293/585] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:10.620197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.658334 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.659109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.659463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.659859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.669742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.671966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:10.684248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:10.685166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:10.686119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 293/586] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:10.686721 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.732675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30856a3b-3a2a-4755-b0d9-4b8d49baa2a0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.765659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:10.775358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.775870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.776282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.788214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.788214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:10.788214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.788214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.794952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 294/587] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:10.794952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.802230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734113d-0c5b-40c2-a8d5-e619ff493018 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.842129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.842741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.843026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.843305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.844070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:10.844383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.846016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:10.855705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:10.867896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 294/588] 10.222.0.82 () {56 vars in 1137 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:10.867896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:10.916953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4d6dd-40d7-4b48-be22-16387ef529f6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.953571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab03381-413a-466e-9f40-19956a5e46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:10.954157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab03381-413a-466e-9f40-19956a5e46fe None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:10.954601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab03381-413a-466e-9f40-19956a5e46fe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:10.955324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab03381-413a-466e-9f40-19956a5e46fe None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/e02a03585caf46fdb09b4a2fdde91a51/roles/d0a36a8f7b0a40d784c17d608a72047e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:10.967790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1482bf-180d-4dbc-815e-4f84cba5833e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:10.971430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab03381-413a-466e-9f40-19956a5e46fe None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=e02a03585caf46fdb09b4a2fdde91a51, role_id=d0a36a8f7b0a40d784c17d608a72047e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:10.972899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab03381-413a-466e-9f40-19956a5e46fe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.002752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.003367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.003649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.003955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.004690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:11.005002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.006470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.023930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 295/589] 10.222.0.82 () {56 vars in 1137 bytes} [Mon Aug 29 18:58:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:11.025388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.057106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 295/590] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:10 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/e02a03585caf46fdb09b4a2fdde91a51/roles/d0a36a8f7b0a40d784c17d608a72047e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:11.069686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab03381-413a-466e-9f40-19956a5e46fe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.103982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:11.136728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:11.160218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa5206-00d8-4ea2-a033-61de8d7d6c6c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.208382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.209124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.210264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.210264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.218086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.219796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.233893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab03381-413a-466e-9f40-19956a5e46fe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:11.234764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:11.236423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 18:58:11.237413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:11.237941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 296/591] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:11.238761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.289524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.290804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.291527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.291993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.305993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.308424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:11.328467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:11.330279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:11.331413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:11.331413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:11.331413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:11.337836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 296/592] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:11.337836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.363121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928559e-1a7d-4395-80d3-b68be5ead272 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.381203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:11.401004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.401731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.402013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.402285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.417075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.418757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:11.435453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:11.442366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:11.443380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:11.443380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:11.443380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:11.443380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 297/593] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:11.443380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.497252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:11.504954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4755f2a-7207-4859-92ce-2de0ee5169fe None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.542704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860bedd-afa2-4c42-a24c-2e5944141bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.543331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860bedd-afa2-4c42-a24c-2e5944141bbc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.543615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860bedd-afa2-4c42-a24c-2e5944141bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.543912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860bedd-afa2-4c42-a24c-2e5944141bbc None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.544651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860bedd-afa2-4c42-a24c-2e5944141bbc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:11.544962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860bedd-afa2-4c42-a24c-2e5944141bbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.546375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860bedd-afa2-4c42-a24c-2e5944141bbc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.567791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 297/594] 10.222.0.82 () {56 vars in 1139 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:11.568276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3e36-3e58-4ec0-8693-a58bda3210f7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.568524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3e36-3e58-4ec0-8693-a58bda3210f7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.568796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb3e36-3e58-4ec0-8693-a58bda3210f7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.570285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 298/595] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:11.570976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3e36-3e58-4ec0-8693-a58bda3210f7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.578542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e7158-8902-4ff1-9678-6beb868667c4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.614927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.615547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.615906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.616184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.616856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:11.617166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.618986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.637313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 298/596] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:11.637313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.668255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:11.687318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb3e36-3e58-4ec0-8693-a58bda3210f7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.730786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468087cb-c0c9-47c8-bc38-c41d0fea4940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.731407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468087cb-c0c9-47c8-bc38-c41d0fea4940 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.731695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468087cb-c0c9-47c8-bc38-c41d0fea4940 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.732001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468087cb-c0c9-47c8-bc38-c41d0fea4940 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.732656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468087cb-c0c9-47c8-bc38-c41d0fea4940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:11.732961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468087cb-c0c9-47c8-bc38-c41d0fea4940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.734330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468087cb-c0c9-47c8-bc38-c41d0fea4940 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.750948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3207e-b3f7-4ac3-9cf8-38e803f31e9e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.751124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 299/597] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:11.751124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409915de-6dc6-40c6-80fa-8a925e0beb26 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.751124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409915de-6dc6-40c6-80fa-8a925e0beb26 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.751124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409915de-6dc6-40c6-80fa-8a925e0beb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.769292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-409915de-6dc6-40c6-80fa-8a925e0beb26 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:11.770487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-409915de-6dc6-40c6-80fa-8a925e0beb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:11.778114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:11.791697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.792562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.792890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.793186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.806227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.808131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:11.824964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:11.825920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:11.826845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:11.826845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:11.826845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:11.826845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 299/598] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:11.827070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.857297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 300/599] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:11.857297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409915de-6dc6-40c6-80fa-8a925e0beb26 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:11.922293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:11.944073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae5d21-67e8-408a-8f53-00cba6ddaa33 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.969542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409915de-6dc6-40c6-80fa-8a925e0beb26 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:11.980830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:11.981621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:11.981736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:11.982058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:11.989814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:11.991584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:12.005133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:12.006078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:12.006975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:12.006975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:12.006975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:12.006975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:12.006975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:12.006975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:12.006975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:12.006975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:12.011311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 300/600] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:12.012287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.015205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.016209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.016715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.017272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.025238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:12.027063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:12.040182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:12.041067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:12.041940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:12.041940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:12.041940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:12.041940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:12.041940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:12.041940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:12.041940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:12.041940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:12.044305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 301/601] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:12.045303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.060062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:12.133328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249ed06-13de-42f3-8219-d9712a431f58 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.169380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.170038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.170317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.170591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.171259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:12.171563 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:12.172945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.174197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb04f6d-a31a-45ec-85af-161cd57e1037 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.183708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:12.186932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 301/602] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:12.187763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.223718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.224363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.224648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.224931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.225636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:12.225947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:12.227376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.245974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 302/603] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:12.245974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.301373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2483c2d-a418-44c5-bba6-e3634b00d5d3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.312308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:12.338824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.339438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.339748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.340095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.340791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:12.341100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:12.342577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.351564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a168-25f5-432a-8e6d-034ffd15e10f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.354181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 302/604] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:12.354984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.392477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d663ef1-ef74-4255-b541-58ef1bbb245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.393506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d663ef1-ef74-4255-b541-58ef1bbb245c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.393992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d663ef1-ef74-4255-b541-58ef1bbb245c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.394478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d663ef1-ef74-4255-b541-58ef1bbb245c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.406043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d663ef1-ef74-4255-b541-58ef1bbb245c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5d663ef1-ef74-4255-b541-58ef1bbb245c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:12.411681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:12.417989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 303/605] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:12.419024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d663ef1-ef74-4255-b541-58ef1bbb245c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.422347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:12.466049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832888-fcb2-4621-92e5-0d49c265e04e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.503752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.504403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.504683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.504954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.512821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:12.514779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:12.526599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:12.527684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:12.528630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 303/606] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:12.529112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.537484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d663ef1-ef74-4255-b541-58ef1bbb245c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.563259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:12.577636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a363f-6a3a-452a-9467-8e404d26e0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.578592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a363f-6a3a-452a-9467-8e404d26e0e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.579041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a363f-6a3a-452a-9467-8e404d26e0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.579322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a363f-6a3a-452a-9467-8e404d26e0e5 None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/1b55bbe406a04cf28244380f5b07eed9/roles/d0a36a8f7b0a40d784c17d608a72047e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.593836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a363f-6a3a-452a-9467-8e404d26e0e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=1b55bbe406a04cf28244380f5b07eed9, role_id=d0a36a8f7b0a40d784c17d608a72047e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:12.595459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a363f-6a3a-452a-9467-8e404d26e0e5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.633035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e4ae8-2cb1-4721-aa41-8ae0c93c6b61 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.653095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:12.664888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 304/607] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:12 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/1b55bbe406a04cf28244380f5b07eed9/roles/d0a36a8f7b0a40d784c17d608a72047e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:12.667712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3033-c0ad-4011-aa62-6930a8fce06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.668615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3033-c0ad-4011-aa62-6930a8fce06b None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.668888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3033-c0ad-4011-aa62-6930a8fce06b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.669223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a3033-c0ad-4011-aa62-6930a8fce06b None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/5786ad6388c54a3f82955e12e8e8f8b3/roles/d0a36a8f7b0a40d784c17d608a72047e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.675658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a363f-6a3a-452a-9467-8e404d26e0e5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.687630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a3033-c0ad-4011-aa62-6930a8fce06b None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=5786ad6388c54a3f82955e12e8e8f8b3, role_id=d0a36a8f7b0a40d784c17d608a72047e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:12.691950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a3033-c0ad-4011-aa62-6930a8fce06b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.788331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 304/608] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:12 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/5786ad6388c54a3f82955e12e8e8f8b3/roles/d0a36a8f7b0a40d784c17d608a72047e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:12.789539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3033-c0ad-4011-aa62-6930a8fce06b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.831041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a363f-6a3a-452a-9467-8e404d26e0e5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.884894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:12.885813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:12.886252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:12.886677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:12.887516 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:12.888039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:12.889641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:12.899965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 305/609] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:12.906424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:12.953120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a3033-c0ad-4011-aa62-6930a8fce06b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:12.957807 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:13.004606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:13.005398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:13.005780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:13.006156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:13.007043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:13.007456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:13.009507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:13.024874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 305/610] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:13.032072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:13.045227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d3a5d-44bd-47e9-91c0-275929f2f8e3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:13.072655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:13.087069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a60d02-a167-4264-aa45-09d720ea160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:13.087853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60d02-a167-4264-aa45-09d720ea160e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:13.088143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60d02-a167-4264-aa45-09d720ea160e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:13.088414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a60d02-a167-4264-aa45-09d720ea160e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:13.099507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a60d02-a167-4264-aa45-09d720ea160e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:13.101578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a60d02-a167-4264-aa45-09d720ea160e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-39a60d02-a167-4264-aa45-09d720ea160e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:13.120873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:13.122070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:13.123181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:13.123181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:13.123181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:13.127512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 306/611] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:13.128918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9730-8aa2-4705-a233-35e305174683 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:13.129210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9730-8aa2-4705-a233-35e305174683 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:13.129492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e9730-8aa2-4705-a233-35e305174683 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:13.131284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 307/612] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:13.134286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e9730-8aa2-4705-a233-35e305174683 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:13.179315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bae46-f666-498c-bdc5-0c5e2e3994cd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:13.223155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4afba-0df3-471e-8b13-737c71cf61b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:13.223894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4afba-0df3-471e-8b13-737c71cf61b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:13.224362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4afba-0df3-471e-8b13-737c71cf61b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:13.224794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4afba-0df3-471e-8b13-737c71cf61b7 None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/218e551387574808b225e73b766b5062/roles/d0a36a8f7b0a40d784c17d608a72047e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:13.240754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:13.241143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4afba-0df3-471e-8b13-737c71cf61b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=218e551387574808b225e73b766b5062, role_id=d0a36a8f7b0a40d784c17d608a72047e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:13.242712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4afba-0df3-471e-8b13-737c71cf61b7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:13.255556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e9730-8aa2-4705-a233-35e305174683 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:13.294664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b2448-e753-4691-a960-1b5476faac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:13.295275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b2448-e753-4691-a960-1b5476faac34 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:13.295558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b2448-e753-4691-a960-1b5476faac34 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:13.295857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b2448-e753-4691-a960-1b5476faac34 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:13.296506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b2448-e753-4691-a960-1b5476faac34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:13.296814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b2448-e753-4691-a960-1b5476faac34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:13.298486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b2448-e753-4691-a960-1b5476faac34 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:13.324517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 308/614] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:13.324517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32541769-7604-44ed-9102-1b2d770763a5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:13.324517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32541769-7604-44ed-9102-1b2d770763a5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:13.324517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32541769-7604-44ed-9102-1b2d770763a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:13.325145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 306/614] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:13 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/218e551387574808b225e73b766b5062/roles/d0a36a8f7b0a40d784c17d608a72047e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:13.327593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4afba-0df3-471e-8b13-737c71cf61b7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:13.362325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-32541769-7604-44ed-9102-1b2d770763a5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:13.367381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-32541769-7604-44ed-9102-1b2d770763a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:13.509841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:13.514431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 309/615] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:13.536562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4afba-0df3-471e-8b13-737c71cf61b7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:13.574803 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:13.575440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:13.575719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:13.576019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:13.584242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:13.585731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:13.597731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:13.598692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:13.599646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:13.600819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 307/616] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:13.606598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32541769-7604-44ed-9102-1b2d770763a5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:13.728188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:13.750974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32541769-7604-44ed-9102-1b2d770763a5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:13.790178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:13.790796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:13.791078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:13.791352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:13.792114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:13.792420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:13.793850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:13.817885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 310/617] 10.222.0.82 () {56 vars in 1135 bytes} [Mon Aug 29 18:58:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:13.823518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:13.913015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:14.074389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc751837-928b-4271-9675-478f7b5b4d62 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:14.090521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf290cf-30fb-4fd5-bec1-3c66142f9cd5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:14.168617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681d55-80ed-4e77-9b13-99315a29644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:14.169691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681d55-80ed-4e77-9b13-99315a29644c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:14.170367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681d55-80ed-4e77-9b13-99315a29644c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:14.171142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30681d55-80ed-4e77-9b13-99315a29644c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:14.177520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:14.192618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30681d55-80ed-4e77-9b13-99315a29644c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:14.196461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:14.197118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:14.197404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:14.197681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-30681d55-80ed-4e77-9b13-99315a29644c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:14.208520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:14.209584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:14.210494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 311/618] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:14.217532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681d55-80ed-4e77-9b13-99315a29644c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:14.229734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:14.244686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:14.246090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:14.288989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:14.290214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:14.291301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:14.291301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:14.291301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:14.294820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 308/619] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:14.300731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:14.393244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30681d55-80ed-4e77-9b13-99315a29644c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:14.483043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:14.483671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:14.483984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:14.484263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:14.484942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:14.485390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:14.487967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:14.506844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 312/620] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:14.513140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:14.540597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2739b-0323-4f88-88f4-8da58b62a912 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:14.609330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:14.609950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:14.610237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:14.610514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:14.611242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:14.611552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:14.617134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:14.635662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:14.646766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 309/621] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:14.650476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:14.718277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845efc6-95b4-44d5-ae5c-3b2714dfcbd7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:14.756112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:14.787698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:14.789289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:14.789582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:14.789864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:14.811762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:14.813232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:14.841270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:14.842251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:14.843136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:14.843136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:14.843136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:14.843709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 313/622] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:14.851964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:14.855015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c76d9c-4164-4d38-bc94-f4f95bee1f0d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:14.943515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:14.943700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:14.945298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:14.946034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:14.961938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:14.965008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:14.986182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:14.987124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:14.988013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:14.988013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:14.988013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:14.988013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:14.988013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:14.988013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:14.988013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:14.988013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:14.996082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 310/623] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:14.996990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:15.077912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaaa16-5b35-4a92-af4b-b3a8e965af11 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:15.099514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:15.150755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bc280-ef4c-4ae6-87c6-7d17ea63916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:15.151390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc280-ef4c-4ae6-87c6-7d17ea63916e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.151678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc280-ef4c-4ae6-87c6-7d17ea63916e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.151991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bc280-ef4c-4ae6-87c6-7d17ea63916e None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.157297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bc280-ef4c-4ae6-87c6-7d17ea63916e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:15.157749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bc280-ef4c-4ae6-87c6-7d17ea63916e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:15.159308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bc280-ef4c-4ae6-87c6-7d17ea63916e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:15.182298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 314/624] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:15.186515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e369d8-d1ca-40bd-b5d8-4d232c6532c8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.187231 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e369d8-d1ca-40bd-b5d8-4d232c6532c8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.188042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e369d8-d1ca-40bd-b5d8-4d232c6532c8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.190285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 315/625] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:15.191036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e369d8-d1ca-40bd-b5d8-4d232c6532c8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:15.216224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1bf7b-bb0f-464e-8de6-6f4c4630aabd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:15.234437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:15.261288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc0eaa-dfe9-490f-9217-91d0a5f5e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:15.264421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc0eaa-dfe9-490f-9217-91d0a5f5e850 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.264421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc0eaa-dfe9-490f-9217-91d0a5f5e850 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.264421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc0eaa-dfe9-490f-9217-91d0a5f5e850 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.264421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc0eaa-dfe9-490f-9217-91d0a5f5e850 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:15.265385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc0eaa-dfe9-490f-9217-91d0a5f5e850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:15.268565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc0eaa-dfe9-490f-9217-91d0a5f5e850 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:15.287525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 311/626] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:15.289248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26630ed2-ac0a-48ab-a3b2-e005558aeb6c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.289885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26630ed2-ac0a-48ab-a3b2-e005558aeb6c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.290369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26630ed2-ac0a-48ab-a3b2-e005558aeb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.312705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-26630ed2-ac0a-48ab-a3b2-e005558aeb6c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:15.315538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-26630ed2-ac0a-48ab-a3b2-e005558aeb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:15.333262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e369d8-d1ca-40bd-b5d8-4d232c6532c8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:15.372317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265299d5-08fc-4559-8aa1-a1afef3ac4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:15.373163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265299d5-08fc-4559-8aa1-a1afef3ac4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.373275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265299d5-08fc-4559-8aa1-a1afef3ac4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.373493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265299d5-08fc-4559-8aa1-a1afef3ac4b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.382227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265299d5-08fc-4559-8aa1-a1afef3ac4b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:15.383932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265299d5-08fc-4559-8aa1-a1afef3ac4b6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:15.390602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 312/627] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:15.391331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26630ed2-ac0a-48ab-a3b2-e005558aeb6c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-265299d5-08fc-4559-8aa1-a1afef3ac4b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:15.400073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:15.401083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:15.402168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:15.410223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 316/628] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:58:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:15.410223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3d26-426e-40ff-b9f4-211d0468660e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.410223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3d26-426e-40ff-b9f4-211d0468660e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.410223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3d26-426e-40ff-b9f4-211d0468660e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.411665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 317/629] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:15.414103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed3d26-426e-40ff-b9f4-211d0468660e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:15.448898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:15.532604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed3d26-426e-40ff-b9f4-211d0468660e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:15.534224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26630ed2-ac0a-48ab-a3b2-e005558aeb6c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:15.536741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:15.571442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ea1a2-81d4-4b72-8c93-762672cc6aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:15.572111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea1a2-81d4-4b72-8c93-762672cc6aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.572367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea1a2-81d4-4b72-8c93-762672cc6aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.572640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ea1a2-81d4-4b72-8c93-762672cc6aa5 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.574630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea1a2-81d4-4b72-8c93-762672cc6aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:15.574945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea1a2-81d4-4b72-8c93-762672cc6aa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:15.576399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ea1a2-81d4-4b72-8c93-762672cc6aa5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:15.581120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361006b-50a5-44ba-ada8-2839fb380d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:15.581909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361006b-50a5-44ba-ada8-2839fb380d0c None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.582264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361006b-50a5-44ba-ada8-2839fb380d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.582550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361006b-50a5-44ba-ada8-2839fb380d0c None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/209e9c8c1a0b41b58f51e94e4bd6c3ff/roles/d0a36a8f7b0a40d784c17d608a72047e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.597457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361006b-50a5-44ba-ada8-2839fb380d0c None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=209e9c8c1a0b41b58f51e94e4bd6c3ff, role_id=d0a36a8f7b0a40d784c17d608a72047e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:15.602678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 318/630] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:58:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:15.602842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361006b-50a5-44ba-ada8-2839fb380d0c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:15.602932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018875f9-6968-4697-8910-8413072ac207 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.602932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018875f9-6968-4697-8910-8413072ac207 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.602932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018875f9-6968-4697-8910-8413072ac207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.619099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-018875f9-6968-4697-8910-8413072ac207 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:15.620304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-018875f9-6968-4697-8910-8413072ac207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:15.669698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 313/631] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:15 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/209e9c8c1a0b41b58f51e94e4bd6c3ff/roles/d0a36a8f7b0a40d784c17d608a72047e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:15.671196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e942ed0-1492-4892-933f-d2c5d56201bc None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.671486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e942ed0-1492-4892-933f-d2c5d56201bc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.671784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e942ed0-1492-4892-933f-d2c5d56201bc None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.678143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 314/632] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:15.678143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e942ed0-1492-4892-933f-d2c5d56201bc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:15.694597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 319/633] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:15.694597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018875f9-6968-4697-8910-8413072ac207 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:15.717259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:15.833696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018875f9-6968-4697-8910-8413072ac207 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:15.848074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e942ed0-1492-4892-933f-d2c5d56201bc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:15.884569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8596c8-4155-4246-a5f7-da345a2d7a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:15.885287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8596c8-4155-4246-a5f7-da345a2d7a07 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.885568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8596c8-4155-4246-a5f7-da345a2d7a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.885855 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8596c8-4155-4246-a5f7-da345a2d7a07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.895255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3deec-e509-48c9-8e13-a7e08bebe4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:15.895908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3deec-e509-48c9-8e13-a7e08bebe4ce None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.896196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3deec-e509-48c9-8e13-a7e08bebe4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.896475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3deec-e509-48c9-8e13-a7e08bebe4ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.897507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8596c8-4155-4246-a5f7-da345a2d7a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9c8596c8-4155-4246-a5f7-da345a2d7a07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:15.902770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:15.903865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:15.904723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 320/634] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:15.906049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf84b-10ae-4b1f-9d64-e9036323accf None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:15.906405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf84b-10ae-4b1f-9d64-e9036323accf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:15.906752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adf84b-10ae-4b1f-9d64-e9036323accf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:15.928237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:15.929883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-64adf84b-10ae-4b1f-9d64-e9036323accf None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:15.931380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-64adf84b-10ae-4b1f-9d64-e9036323accf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:15.973393 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3deec-e509-48c9-8e13-a7e08bebe4ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:15.976588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3deec-e509-48c9-8e13-a7e08bebe4ce None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:16.018155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 321/635] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:16.019004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adf84b-10ae-4b1f-9d64-e9036323accf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.033804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:16.092399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 315/636] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:16.093454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3deec-e509-48c9-8e13-a7e08bebe4ce None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.146949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adf84b-10ae-4b1f-9d64-e9036323accf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.158336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:16.190414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.191037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.191331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.191600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.192418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:16.192730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:16.194387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:16.209993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 322/637] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:16.209993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.234284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3deec-e509-48c9-8e13-a7e08bebe4ce None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.273505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f64a1-7148-4a88-9b27-861bd3d11d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.274533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f64a1-7148-4a88-9b27-861bd3d11d3a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.275026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f64a1-7148-4a88-9b27-861bd3d11d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.275510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f64a1-7148-4a88-9b27-861bd3d11d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.286903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f64a1-7148-4a88-9b27-861bd3d11d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:16.287442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-872f64a1-7148-4a88-9b27-861bd3d11d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:16.293441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:16.294370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:16.295236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:16.303100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 316/638] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:16.304286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f64a1-7148-4a88-9b27-861bd3d11d3a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.324588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a8894-f3f5-4fbf-bae7-b36345b7d715 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.363005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.363559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.363873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.364153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.375400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:16.377478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:16.392156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:16.393370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:16.394682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:16.394682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:16.394682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:16.394682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 323/639] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:16.394682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.420896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f64a1-7148-4a88-9b27-861bd3d11d3a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.436408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:16.459522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.460321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.460605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.460887 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.472472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:16.473907 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:16.489742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:16.490734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:16.491633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:16.491633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:16.491633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:16.491633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 317/640] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:16.491633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.506936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c9de6-e796-4e26-a3a7-2b6d06f526d9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.527037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:16.545388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.546148 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.546435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.546707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.547372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:16.547684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:16.549873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:16.559616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 324/641] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:16.560496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.617361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12d96-bb06-4527-8f2f-1456025d3da6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.653392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d0f7-916e-40a8-908e-ccc576d51b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.654028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d0f7-916e-40a8-908e-ccc576d51b80 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.654312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d0f7-916e-40a8-908e-ccc576d51b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.654583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d0f7-916e-40a8-908e-ccc576d51b80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.666061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb45d0f7-916e-40a8-908e-ccc576d51b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:16.667489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e31397-43d6-4dc7-9fd8-018887b6e88a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-fb45d0f7-916e-40a8-908e-ccc576d51b80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:16.671608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:16.672698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 318/642] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:16.676835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d0f7-916e-40a8-908e-ccc576d51b80 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.703412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:16.706394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.707017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.707301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.707581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.708355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:16.708910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:16.710308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:16.723987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 325/643] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:16.724699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.772295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:16.793884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d0f7-916e-40a8-908e-ccc576d51b80 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.832355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.833135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.833528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.833969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.834501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:16.834955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:16.836206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:16.840697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7fc02-cd4c-4df9-8eaf-be4980502d03 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:16.851784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 319/644] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:16.852767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.880694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:16.881252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:16.881532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:16.881806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:16.892836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:16.894287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:16.908853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:16.909792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:16.910839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:16.910839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:16.910839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:16.914751 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 326/645] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:16.915573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:16.954722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:16.972596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33011b6-4608-4070-859c-e53ae4327b1a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.009548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.010152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.010433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.010705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.011362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:17.011520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:17.011647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.013021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.018581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6038df-3ad3-497d-afbb-71e5a0766c5f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.020982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 320/646] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:17.028703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.060973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.061707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.061990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.062267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.070545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.072008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:17.085734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:17.086610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 327/647] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:17.087472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.132767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ed478-327a-4f1b-8838-86a837fb0ad6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.167342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.168000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.168279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.168551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.176611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.178044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:17.190039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:17.191011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 321/648] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:17.191982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.201733 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:17.211083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea258620-6c21-49c0-ae8d-27336f113137 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.247740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.248352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.248638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.248916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.249561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:17.249874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.251285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.263684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 328/649] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:17.268447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.287370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:17.309309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde973b3-7884-46a9-ad6a-2528be8946c6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.344555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.345221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.345569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.345759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.357400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.358827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:17.376036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:17.377793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:17.379251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:17.379251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:17.379251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:17.379251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 322/650] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:17.379251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.391051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bed40f-321e-4a66-82a4-f7fe1594d5c1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.428388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.428999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.429281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.429559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.430248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:17.430558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.432010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.444465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 329/651] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:17.445535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.450340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:17.492356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c74354-42d0-423a-9c77-7b95604991d2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.525253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:17.527815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.528426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.528710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.528984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.529708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:17.530018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.531430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.551460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e138198-19b6-415c-ad95-d2a90d1adbfc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.559384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 323/652] 10.222.0.82 () {56 vars in 1137 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:17.559384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.585969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.586603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.586886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.587160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.594819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.597020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:17.608201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:17.609227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 330/653] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:17.610920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.663052 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6db01-8392-4b7c-94a2-f849d830ac27 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.696966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.697568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.697847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.698117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.698809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:17.699366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.700584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.709546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:17.712725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156aaf-b20c-4a31-b274-5c969fad1775 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.714043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 324/654] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:17.714844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.745537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674572b-5854-4db9-8073-7992833cecac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.746144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674572b-5854-4db9-8073-7992833cecac None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.746426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674572b-5854-4db9-8073-7992833cecac None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.746699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674572b-5854-4db9-8073-7992833cecac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.747416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674572b-5854-4db9-8073-7992833cecac None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=e02a03585caf46fdb09b4a2fdde91a51) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:17.747739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674572b-5854-4db9-8073-7992833cecac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.749161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674572b-5854-4db9-8073-7992833cecac None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.755320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 331/655] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/role_assignments?user.id=e02a03585caf46fdb09b4a2fdde91a51&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:17.756122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674572b-5854-4db9-8073-7992833cecac None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:17.760839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:17.824595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e54e3-df6f-4cd9-a470-ffb5b27f480c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.866434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadcee1-1555-4d2c-b2bb-07aafd10f695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.867068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadcee1-1555-4d2c-b2bb-07aafd10f695 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.867514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadcee1-1555-4d2c-b2bb-07aafd10f695 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.867827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadcee1-1555-4d2c-b2bb-07aafd10f695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.889563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674572b-5854-4db9-8073-7992833cecac None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:17.928151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:17.940542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3671b9-d407-4c23-bdd6-9206dcf848ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:17.943357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3671b9-d407-4c23-bdd6-9206dcf848ce None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.943357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3671b9-d407-4c23-bdd6-9206dcf848ce None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.943357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3671b9-d407-4c23-bdd6-9206dcf848ce None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.943357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3671b9-d407-4c23-bdd6-9206dcf848ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:17.943357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3671b9-d407-4c23-bdd6-9206dcf848ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.945786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3671b9-d407-4c23-bdd6-9206dcf848ce None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.963759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadcee1-1555-4d2c-b2bb-07aafd10f695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:17.965186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaadcee1-1555-4d2c-b2bb-07aafd10f695 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:17.972232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 332/656] 10.222.0.82 () {56 vars in 1137 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:17.972232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453e910-eb3c-402c-be3d-7bca9abb1580 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:17.972232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453e910-eb3c-402c-be3d-7bca9abb1580 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:17.972232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453e910-eb3c-402c-be3d-7bca9abb1580 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:17.972232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 333/657] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:17.972714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453e910-eb3c-402c-be3d-7bca9abb1580 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:18.047321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:18.099627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 325/658] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:18.100874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362620-9044-4d06-8421-0e8b5685f75e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.101163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362620-9044-4d06-8421-0e8b5685f75e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.101453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362620-9044-4d06-8421-0e8b5685f75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.112755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453e910-eb3c-402c-be3d-7bca9abb1580 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:18.122629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b4362620-9044-4d06-8421-0e8b5685f75e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:18.123873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b4362620-9044-4d06-8421-0e8b5685f75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:18.163931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:18.165072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.165547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.166072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.177890 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:18.179526 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:18.196152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:18.197191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 334/659] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:18.205840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:18.226527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 326/660] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:18.227986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362620-9044-4d06-8421-0e8b5685f75e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:18.237648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:18.355355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8cd14-4aac-4e1c-8b32-6fc2274fe867 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:18.360051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362620-9044-4d06-8421-0e8b5685f75e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:18.375087 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:18.396036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec079442-49e5-4563-b7db-c16ca9a71960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:18.397056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec079442-49e5-4563-b7db-c16ca9a71960 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.397523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec079442-49e5-4563-b7db-c16ca9a71960 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.398067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec079442-49e5-4563-b7db-c16ca9a71960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.404600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:18.405450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.405732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.405997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.421094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:18.424193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:18.448565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:18.449568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:18.450445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:18.450445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:18.450445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:18.452701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 327/661] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:18.453839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:18.505061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec079442-49e5-4563-b7db-c16ca9a71960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:18.507032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec079442-49e5-4563-b7db-c16ca9a71960 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:18.520762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:18.571437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c78af-a704-465b-8bef-790da0fbbbd0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:18.615678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:18.616621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.616902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.617188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.617915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:18.618221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:18.619651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:18.642670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 335/662] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:18.643042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 328/663] 10.222.0.82 () {56 vars in 1139 bytes} [Mon Aug 29 18:58:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:18.643150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec079442-49e5-4563-b7db-c16ca9a71960 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:18.643235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:18.660144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:18.749648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec079442-49e5-4563-b7db-c16ca9a71960 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:18.749999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bd7c6-aa41-4c02-816e-4c5b7fd22190 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:18.768305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:18.786886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:18.787276 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df2cb-c01c-40c5-9187-cb07f2d75d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:18.788006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df2cb-c01c-40c5-9187-cb07f2d75d2d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.788392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df2cb-c01c-40c5-9187-cb07f2d75d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.788504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.788713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.788944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df2cb-c01c-40c5-9187-cb07f2d75d2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.789092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.789706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:18.789967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:18.791308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:18.801988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555df2cb-c01c-40c5-9187-cb07f2d75d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:18.808304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 336/664] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:18.808304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-555df2cb-c01c-40c5-9187-cb07f2d75d2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:18.808535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:18.809442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 329/665] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:18.810294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df2cb-c01c-40c5-9187-cb07f2d75d2d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:18.894362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:18.917916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555df2cb-c01c-40c5-9187-cb07f2d75d2d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:18.918243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdcd5c2-616e-4228-8d56-425543a72a71 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:18.953929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:18.954810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.955184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.955467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.957769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93d07a-a720-4bd5-95f0-9d8fad684e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:18.958673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93d07a-a720-4bd5-95f0-9d8fad684e7f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:18.959167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93d07a-a720-4bd5-95f0-9d8fad684e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:18.959707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93d07a-a720-4bd5-95f0-9d8fad684e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:18.967109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:18.968656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:18.987719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:18.988782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:18.989659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:18.989659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:18.989659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:18.989659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 337/666] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:18.989659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.011471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:19.035327 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93d07a-a720-4bd5-95f0-9d8fad684e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.036116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93d07a-a720-4bd5-95f0-9d8fad684e7f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.109887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd9d27-b36d-4a1b-863f-f594ddd35792 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.136951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:19.145670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.146775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.147271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.147761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.148617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:19.148987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.149894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 330/667] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:19.150625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.150861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93d07a-a720-4bd5-95f0-9d8fad684e7f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.166128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 338/668] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:19.167018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.239380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:19.263626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93d07a-a720-4bd5-95f0-9d8fad684e7f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.279381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df20d4-b384-4383-a759-1bc103912c8d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.300629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.301495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.301932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.302305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.309789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.311316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.313968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.314577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.314858 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.315136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.315821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:19.316132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.317482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:19.324208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:19.325285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:19.326375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:19.326375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:19.326375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:19.326375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:19.326375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:19.326375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:19.326375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:19.326375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:19.332311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 331/669] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:19.332311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.337960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 339/670] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:19.342430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.396665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:19.441977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee321ed-5c7d-4281-a6a5-4cc6d3df0f7c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.451145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d21867-be31-43ba-b140-2cca6726a582 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.478309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.478945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.479207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.479475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.482564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:19.489703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.490346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.490632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.490912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.491013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.492402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.503067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.504539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:19.508428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:19.509369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:19.515218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:19.515218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:19.515218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:19.515218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 332/671] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:19.515218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:19.525738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:19.526720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:19.527639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:19.527639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:19.527639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:19.527639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 340/672] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:19.528628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.628171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ba978-3678-42e0-b7f7-0582431a4a26 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.635080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11583df6-d520-4f99-85b5-3396d1b95dd0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.636638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:19.664269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.665216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.665671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.666140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.667208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:19.667828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.669456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.669940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.670092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.670356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.670630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.678354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.681078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:19.693040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:19.693965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:19.694891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 341/673] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:19.696527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.696670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 333/674] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:19.696916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.751903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:19.805949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895144b-7018-41cf-a7a2-1d03eb882156 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.810680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505ca0-b8ec-4baf-836c-dfe672951038 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.843407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.844412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.844867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.845798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.846544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:19.846954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.848504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.849132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:19.849741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:19.850024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:19.850296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:19.850929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:19.851237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:19.852606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:19.866584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 342/675] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:19.866584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.870139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 334/676] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:19.870139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:19.888645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:19.979429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9851924-c5b0-410e-bca2-9539cfd2f91c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:19.989542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648873b-ad94-48d8-84f2-54c47720d981 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:20.000798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:20.017796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a4543-649b-4ccd-9053-9ebdaf748658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.018422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4543-649b-4ccd-9053-9ebdaf748658 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.018682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4543-649b-4ccd-9053-9ebdaf748658 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.018951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a4543-649b-4ccd-9053-9ebdaf748658 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.019635 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a4543-649b-4ccd-9053-9ebdaf748658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:20.019990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a4543-649b-4ccd-9053-9ebdaf748658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:20.021405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a4543-649b-4ccd-9053-9ebdaf748658 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:20.024007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.024621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.024900 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.025175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.025891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=1b55bbe406a04cf28244380f5b07eed9) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:20.026201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:20.027674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:20.033136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 343/677] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:20.033753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 335/678] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:19 2022] GET /identity/v3/role_assignments?user.id=1b55bbe406a04cf28244380f5b07eed9&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:20.034874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:20.037042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209ff3-99b2-40d4-9bdc-189578332eb9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.038098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209ff3-99b2-40d4-9bdc-189578332eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.038402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209ff3-99b2-40d4-9bdc-189578332eb9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.041017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 344/679] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:20.041017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209ff3-99b2-40d4-9bdc-189578332eb9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:20.137139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:20.162012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e74a6c-eb26-4c38-b4b9-0be22bb20a2d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:20.163666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209ff3-99b2-40d4-9bdc-189578332eb9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:20.205202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.206611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.206611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.207300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.211461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f2899-45e8-4cb3-86eb-81b73ee756b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.211923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2899-45e8-4cb3-86eb-81b73ee756b3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.212950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2899-45e8-4cb3-86eb-81b73ee756b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.212950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f2899-45e8-4cb3-86eb-81b73ee756b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.215403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:20.216898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:20.221707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f2899-45e8-4cb3-86eb-81b73ee756b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:20.223152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f2899-45e8-4cb3-86eb-81b73ee756b3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:20.229951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:20.231040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:20.232239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 345/680] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:20.232917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-245f2899-45e8-4cb3-86eb-81b73ee756b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:20.235146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:20.236248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:20.237739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:20.237739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:20.237739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:20.237739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:20.237739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:20.237739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:20.237739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:20.237739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:20.244078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 336/681] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:20.245665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ce6b-5171-49a5-a12b-0f27677e8804 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.246113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ce6b-5171-49a5-a12b-0f27677e8804 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.246563 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61ce6b-5171-49a5-a12b-0f27677e8804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.267425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ca61ce6b-5171-49a5-a12b-0f27677e8804 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:20.268659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ca61ce6b-5171-49a5-a12b-0f27677e8804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:20.300537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:20.348928 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce67f1f-64ef-4f87-90bc-90790bef769c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:20.356925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 337/682] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:20.357583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61ce6b-5171-49a5-a12b-0f27677e8804 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:20.402209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.402730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.403119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.403554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.404398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=5786ad6388c54a3f82955e12e8e8f8b3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:20.405404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:20.406548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:20.420292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 346/683] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/role_assignments?user.id=5786ad6388c54a3f82955e12e8e8f8b3&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:20.429940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:20.436040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:20.492272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61ce6b-5171-49a5-a12b-0f27677e8804 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:20.536514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.537651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.538150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.538886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.540402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:20.540911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:20.542704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:20.565664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 338/684] 10.222.0.82 () {56 vars in 1135 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:20.572121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:20.597791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:20.624076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5c45f-854f-4533-bdd6-071622396ccd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:20.682894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.683464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.683716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.684020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.684724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:20.685038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:20.686481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:20.696085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594fa7-cfd3-4615-8beb-ead4233026ef None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:20.699963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 347/685] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:20.700723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:20.739116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fede7ab-af95-4b8e-9fe4-96bbbbe2aa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.740154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fede7ab-af95-4b8e-9fe4-96bbbbe2aa2c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.740837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fede7ab-af95-4b8e-9fe4-96bbbbe2aa2c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.741128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fede7ab-af95-4b8e-9fe4-96bbbbe2aa2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.779776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:20.827805 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64e5c8-00cf-4088-b2ff-94ae992fcaac None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:20.841682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fede7ab-af95-4b8e-9fe4-96bbbbe2aa2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:20.843966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fede7ab-af95-4b8e-9fe4-96bbbbe2aa2c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:20.872067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:20.873040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468353-21ea-4e3b-b93e-3ea9308fd62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:20.873676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468353-21ea-4e3b-b93e-3ea9308fd62e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:20.873952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468353-21ea-4e3b-b93e-3ea9308fd62e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:20.874377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468353-21ea-4e3b-b93e-3ea9308fd62e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:20.890553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8468353-21ea-4e3b-b93e-3ea9308fd62e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f8468353-21ea-4e3b-b93e-3ea9308fd62e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:20.896321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:20.897481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:20.898767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:20.900345 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 348/686] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:20.901454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468353-21ea-4e3b-b93e-3ea9308fd62e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:20.982060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 339/687] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:20.982964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fede7ab-af95-4b8e-9fe4-96bbbbe2aa2c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:21.021185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468353-21ea-4e3b-b93e-3ea9308fd62e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.056529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:21.068474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:21.071836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:21.071836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:21.071836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:21.071836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=218e551387574808b225e73b766b5062) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:21.071836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:21.073875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:21.087128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 349/688] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/role_assignments?user.id=218e551387574808b225e73b766b5062&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:21.087128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:21.120629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fede7ab-af95-4b8e-9fe4-96bbbbe2aa2c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.178591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:21.223532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:21.226212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:21.226492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:21.226765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:21.227471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:21.229891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f7a59-4578-4da0-924a-276d1a4f2582 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.231610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:21.233155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:21.254325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 340/689] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:21.260064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:21.302639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:21.303279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:21.303560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:21.304025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:21.318869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:21.320642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:21.339028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:21.340038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:21.341121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:21.341121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:21.341121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:21.341121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 350/690] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:21.346979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:21.398211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f232dfe0-edcf-422a-ae60-f99af022e7ec None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.401446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:21.440290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:21.440932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:21.441217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:21.441491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:21.454587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:21.456696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:21.469918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661db5f-a6a4-4926-8989-5435a6aca793 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:21.474616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:21.476867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:21.479099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:21.479099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:21.479099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:21.479099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 341/691] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:21.489354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:21.514625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:21.515349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:21.515638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:21.515948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:21.516604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:21.517452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:21.518933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:21.533955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:21.534407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 351/692] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:21.540705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:21.618995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b5e08-b34b-46a9-b30a-d3d31fde05da None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.664817 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd8be1-2ad7-458c-bb16-4165af4e950b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.666596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:21.692477 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:21.693105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:21.693390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:21.693667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:21.694330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:21.694641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:21.698135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:21.707264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:21.707926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:21.708205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:21.708480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:21.716283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:21.717727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:21.723993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 342/693] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:21.729348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:21.731706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:21.733816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:21.736025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 352/694] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:21.740952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:21.896459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:21.904728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42ca86-c05e-4403-a4e6-158402477967 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.940972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b727-1896-4745-b03a-6e8e2794c86b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:21.942026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:21.942825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:21.943111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:21.943388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:21.951409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:21.952982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:21.965999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:21.968408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:21.970724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 343/695] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:58:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:21.976215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:22.016538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:22.017382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.017649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.017924 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.018643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:22.018956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:22.020936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:22.042243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 353/696] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:22.049852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:22.096425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:22.102006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b24edfe-80b1-4601-914d-774daf2d1a40 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:22.175260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c47d98-6b4c-4bf5-a760-562da81ade6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:22.176109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47d98-6b4c-4bf5-a760-562da81ade6d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.176395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47d98-6b4c-4bf5-a760-562da81ade6d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.176675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c47d98-6b4c-4bf5-a760-562da81ade6d None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.177429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c47d98-6b4c-4bf5-a760-562da81ade6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:22.177739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c47d98-6b4c-4bf5-a760-562da81ade6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:22.179163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c47d98-6b4c-4bf5-a760-562da81ade6d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:22.213584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 344/697] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:58:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:22.214995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efe93-197f-4a09-8b35-3bce93735a28 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.215292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efe93-197f-4a09-8b35-3bce93735a28 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.215574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15efe93-197f-4a09-8b35-3bce93735a28 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.221903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 345/698] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:22.222676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15efe93-197f-4a09-8b35-3bce93735a28 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:22.238039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe271a-9e68-4cd3-8e0f-e37c7890c425 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:22.238840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:22.278028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e51c6-6cc5-4b18-b467-ef7ec868b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:22.278774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e51c6-6cc5-4b18-b467-ef7ec868b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.278914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e51c6-6cc5-4b18-b467-ef7ec868b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.279092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e51c6-6cc5-4b18-b467-ef7ec868b4d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.279883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e51c6-6cc5-4b18-b467-ef7ec868b4d7 None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=209e9c8c1a0b41b58f51e94e4bd6c3ff) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:22.280185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e51c6-6cc5-4b18-b467-ef7ec868b4d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:22.281618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e51c6-6cc5-4b18-b467-ef7ec868b4d7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:22.292977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 354/699] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:22 2022] GET /identity/v3/role_assignments?user.id=209e9c8c1a0b41b58f51e94e4bd6c3ff&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:22.292977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c970-65bb-4560-9648-fb7600ef1625 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.292977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c970-65bb-4560-9648-fb7600ef1625 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.292977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24c970-65bb-4560-9648-fb7600ef1625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.328927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8d24c970-65bb-4560-9648-fb7600ef1625 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:22.330806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8d24c970-65bb-4560-9648-fb7600ef1625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:22.357856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15efe93-197f-4a09-8b35-3bce93735a28 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:22.399922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d45096-d13c-4c37-8705-629b031ed177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:22.400870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d45096-d13c-4c37-8705-629b031ed177 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.401526 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d45096-d13c-4c37-8705-629b031ed177 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.401991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d45096-d13c-4c37-8705-629b031ed177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.472815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 355/700] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:22.486761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d45096-d13c-4c37-8705-629b031ed177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:22.488570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d45096-d13c-4c37-8705-629b031ed177 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:22.505473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:22.605756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 346/701] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:22.612368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c970-65bb-4560-9648-fb7600ef1625 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:22.635133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:22.721076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371fcd0-bbb4-4ce2-94a2-689a00f57b43 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.721400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371fcd0-bbb4-4ce2-94a2-689a00f57b43 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.721559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371fcd0-bbb4-4ce2-94a2-689a00f57b43 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.723202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 347/702] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:22.731308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777d72-f1f5-451e-a401-b735518f13d9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.731308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777d72-f1f5-451e-a401-b735518f13d9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.731308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21777d72-f1f5-451e-a401-b735518f13d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.733457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24c970-65bb-4560-9648-fb7600ef1625 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:22.754215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-21777d72-f1f5-451e-a401-b735518f13d9 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:22.755899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-21777d72-f1f5-451e-a401-b735518f13d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:22.778273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:22.779263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:22.779780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:22.780288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:22.791667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:22.793408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:22.810574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:22.816764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:22.819018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:22.819018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:22.819018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:22.819018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 356/703] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:22.821033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:22.842850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 348/704] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:22.859975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21777d72-f1f5-451e-a401-b735518f13d9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:22.924042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:22.928068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:22.968333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4678000-4aee-4f02-aa5d-c532f03b18f3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.005275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21777d72-f1f5-451e-a401-b735518f13d9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.010690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.011302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.011585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.011892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.012540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:23.012847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.014218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.027153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 357/705] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:23.033141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:23.045794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.046962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.047488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.048029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.048863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.050524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:23.062711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:23.064398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:23.065255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:23.068077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 349/706] 10.222.0.82 () {56 vars in 1129 bytes} [Mon Aug 29 18:58:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:23.077028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:23.155290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f737cd-65ea-4e9b-a5f3-4294673fa6e0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.190897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:23.199925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.216469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.216469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.216469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.217519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790d534-13f1-4da7-8768-470ce1f7ea31 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.217519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:23.217693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.217693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:23.228983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:23.230023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:23.230925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:23.230925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:23.230925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:23.230925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:23.230925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:23.230925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:23.230925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:23.230925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:23.231380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 358/707] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:23.232725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:23.240619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.241240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.241516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.241894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.242590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:23.242898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.244559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.249978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 350/708] 10.222.0.82 () {56 vars in 1124 bytes} [Mon Aug 29 18:58:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:23.251574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:23.357485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef49e-499e-40af-b186-632efc9a6361 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.383956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ae8f3-153a-457e-9967-e1223e2c5131 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.397898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.398549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.398833 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.399111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.414775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.416336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.427712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.428610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.429134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.429659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.430819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:23.431126 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:23.432317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:23.435076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:23.439386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:23.439386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:23.439386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:23.440119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.440439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 359/709] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:23.440439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:23.463291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 351/710] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:23.464922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:23.485917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:23.512445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:23.556964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b7909-4f8c-4990-a196-3499067446f9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.597368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.597989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.598427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.598722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.600457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:23.600774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.602174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.611870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 360/711] 10.222.0.82 () {56 vars in 1124 bytes} [Mon Aug 29 18:58:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:23.611870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:23.623507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3b8c-f39c-4ceb-b4cc-3c3eba3a6ac1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.672360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.673677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.674271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.674774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.675642 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:23.676396 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.678813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.703648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 352/712] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:23.717139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:23.735266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da3d0d-40a0-49de-9569-7f4c8783fb89 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.738283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:23.878773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:23.890503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bd229-d1a0-4488-bdf7-3cd514fc83bd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:23.909867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c197d-a722-4a85-a7a7-cd9d8576ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.910483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c197d-a722-4a85-a7a7-cd9d8576ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.910903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c197d-a722-4a85-a7a7-cd9d8576ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.911185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c197d-a722-4a85-a7a7-cd9d8576ddd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.911995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c197d-a722-4a85-a7a7-cd9d8576ddd7 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=e02a03585caf46fdb09b4a2fdde91a51) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:23.912310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c197d-a722-4a85-a7a7-cd9d8576ddd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.913764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c197d-a722-4a85-a7a7-cd9d8576ddd7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.920091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 361/713] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:23 2022] GET /identity/v3/role_assignments?user.id=e02a03585caf46fdb09b4a2fdde91a51&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:23.921468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657407-2ce4-4915-9d43-a98f5ec63198 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.921758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657407-2ce4-4915-9d43-a98f5ec63198 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.922034 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf657407-2ce4-4915-9d43-a98f5ec63198 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.925059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 362/714] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:23.933268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9b76-79ab-4be9-b7f3-ffd53bbadbe5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.933848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9b76-79ab-4be9-b7f3-ffd53bbadbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.934317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f9b76-79ab-4be9-b7f3-ffd53bbadbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.944251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f096ad-4a01-44b9-b455-6e35286622e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:23.947228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f096ad-4a01-44b9-b455-6e35286622e0 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:23.947520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f096ad-4a01-44b9-b455-6e35286622e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:23.949040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f096ad-4a01-44b9-b455-6e35286622e0 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:23.949810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f096ad-4a01-44b9-b455-6e35286622e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:23.951620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f096ad-4a01-44b9-b455-6e35286622e0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:23.956949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-424f9b76-79ab-4be9-b7f3-ffd53bbadbe5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:23.958533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-424f9b76-79ab-4be9-b7f3-ffd53bbadbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:24.045574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 363/715] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:24.058858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 353/716] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:58:23 2022] POST /identity/v3/users => generated 254 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:24.357330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f9b76-79ab-4be9-b7f3-ffd53bbadbe5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:24.472933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:24.483573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f9b76-79ab-4be9-b7f3-ffd53bbadbe5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:24.528079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:24.528730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:24.528984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:24.529259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] PATH_INFO: `/v3/services/network` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:24.529849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:24.531210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:24.545619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:24.546663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:24.548745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 364/717] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:24 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:24.552905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f096ad-4a01-44b9-b455-6e35286622e0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:24.661591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f096ad-4a01-44b9-b455-6e35286622e0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:24.696825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a13c8f-5435-49af-a0f0-cbb7f95a1040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:24.697448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13c8f-5435-49af-a0f0-cbb7f95a1040 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:24.697730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13c8f-5435-49af-a0f0-cbb7f95a1040 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:24.698005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a13c8f-5435-49af-a0f0-cbb7f95a1040 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:24.698644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13c8f-5435-49af-a0f0-cbb7f95a1040 None admin] RBAC: Adding query filter params (name=network) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:24.698949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13c8f-5435-49af-a0f0-cbb7f95a1040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:24.700349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a13c8f-5435-49af-a0f0-cbb7f95a1040 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:24.706201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 354/718] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:24.711762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:24.825282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90432695-b154-4b43-a7bf-f3dfe87c2d0a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:24.876842 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af2428-25fb-4ed7-9d8f-7e6d9af3ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:24.877461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af2428-25fb-4ed7-9d8f-7e6d9af3ce87 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:24.877743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af2428-25fb-4ed7-9d8f-7e6d9af3ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:24.878017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af2428-25fb-4ed7-9d8f-7e6d9af3ce87 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:24.878662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af2428-25fb-4ed7-9d8f-7e6d9af3ce87 None admin] RBAC: Adding query filter params (type=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:24.878971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af2428-25fb-4ed7-9d8f-7e6d9af3ce87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:24.880375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af2428-25fb-4ed7-9d8f-7e6d9af3ce87 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:24.892209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 365/719] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:25.545025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f870-a264-4a6c-9c78-1de165302ca2 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:25.546029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f870-a264-4a6c-9c78-1de165302ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:25.546589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56f870-a264-4a6c-9c78-1de165302ca2 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:25.549189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 355/720] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:25.554269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257609-e803-4ef4-92cd-9226072b7981 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:25.554717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257609-e803-4ef4-92cd-9226072b7981 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:25.554891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257609-e803-4ef4-92cd-9226072b7981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:25.580731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bb257609-e803-4ef4-92cd-9226072b7981 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:25.581946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bb257609-e803-4ef4-92cd-9226072b7981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:25.607204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:25.676084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 366/721] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:26.080230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783be1-fef1-432c-bb79-cd80fa459a1d None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.080972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783be1-fef1-432c-bb79-cd80fa459a1d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.081474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48783be1-fef1-432c-bb79-cd80fa459a1d None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.083330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 356/722] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:26.088299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ba81-c3e9-4a32-a413-bf6883223237 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.088846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ba81-c3e9-4a32-a413-bf6883223237 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.089334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42ba81-c3e9-4a32-a413-bf6883223237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.112926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ab42ba81-c3e9-4a32-a413-bf6883223237 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:26.114197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783be1-fef1-432c-bb79-cd80fa459a1d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:26.127433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ab42ba81-c3e9-4a32-a413-bf6883223237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:26.129569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:26.286072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 367/723] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:58:26.315325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48783be1-fef1-432c-bb79-cd80fa459a1d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:26.360680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b92541-2db0-4780-a21e-867f8331e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:26.361300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92541-2db0-4780-a21e-867f8331e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.361583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92541-2db0-4780-a21e-867f8331e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.361854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92541-2db0-4780-a21e-867f8331e3d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.378611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b92541-2db0-4780-a21e-867f8331e3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-00b92541-2db0-4780-a21e-867f8331e3d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:26.383913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:26.384838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:26.386106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 357/724] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:26.393720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ba81-c3e9-4a32-a413-bf6883223237 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:26.484162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:26.499864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42ba81-c3e9-4a32-a413-bf6883223237 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:26.539941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:26.540557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.540834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.541108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.541782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:26.542083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:26.543444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:26.553292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bd164-194a-4c78-a78d-59658580995d None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.554225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bd164-194a-4c78-a78d-59658580995d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.554746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 368/725] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:26.555325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3bd164-194a-4c78-a78d-59658580995d None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.559260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 358/726] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:26.561373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:26.562994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969faf-2277-49ac-b610-18a14178733f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.564159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969faf-2277-49ac-b610-18a14178733f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.564682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff969faf-2277-49ac-b610-18a14178733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.584515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ff969faf-2277-49ac-b610-18a14178733f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:26.586065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ff969faf-2277-49ac-b610-18a14178733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:26.658025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:26.664828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 359/727] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 18:58:26.665919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff969faf-2277-49ac-b610-18a14178733f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:26.698430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4d1bd-a7a2-4f08-a207-76e25c67ebf6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:26.768169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:26.768814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.769099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.769378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.792601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:26.794578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:26.811549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:26.827853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff969faf-2277-49ac-b610-18a14178733f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:26.828111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:26.829770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:26.830647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:26.830647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:26.830647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:26.830647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 369/728] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:26.836746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:26.868654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6498b6-7f63-4cb1-b8f7-e6dc3fbfa7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:26.869668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6498b6-7f63-4cb1-b8f7-e6dc3fbfa7df None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.870189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6498b6-7f63-4cb1-b8f7-e6dc3fbfa7df None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.870660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6498b6-7f63-4cb1-b8f7-e6dc3fbfa7df None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.871662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6498b6-7f63-4cb1-b8f7-e6dc3fbfa7df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:26.873438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6498b6-7f63-4cb1-b8f7-e6dc3fbfa7df None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:26.967291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f0295-12e7-45c7-b8a9-b03cbc55f2da None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:26.987344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 360/729] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:58:26 2022] POST /identity/v3/services => generated 251 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:26.988957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd391a-e643-445a-9939-e497c9de0b93 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:26.989517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd391a-e643-445a-9939-e497c9de0b93 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:26.990013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd391a-e643-445a-9939-e497c9de0b93 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:26.991700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 361/730] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:26.992828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd391a-e643-445a-9939-e497c9de0b93 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.022017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bbac8-f564-4b16-af0e-649ec41be4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.022702 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bbac8-f564-4b16-af0e-649ec41be4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.023025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bbac8-f564-4b16-af0e-649ec41be4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.023306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bbac8-f564-4b16-af0e-649ec41be4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.024002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bbac8-f564-4b16-af0e-649ec41be4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:27.024379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bbac8-f564-4b16-af0e-649ec41be4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:27.026337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bbac8-f564-4b16-af0e-649ec41be4d9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:27.046048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 370/731] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:27.048690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660e93-e3a7-4b5d-a58d-98684f21dc85 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.049243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660e93-e3a7-4b5d-a58d-98684f21dc85 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.049824 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d660e93-e3a7-4b5d-a58d-98684f21dc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.071450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6d660e93-e3a7-4b5d-a58d-98684f21dc85 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:27.072891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6d660e93-e3a7-4b5d-a58d-98684f21dc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:27.073515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:27.128591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd391a-e643-445a-9939-e497c9de0b93 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:27.150712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:27.175764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 371/732] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:27.178071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660e93-e3a7-4b5d-a58d-98684f21dc85 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.191211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fd72f-e708-4e62-a811-739ee680035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.192043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fd72f-e708-4e62-a811-739ee680035a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.192488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fd72f-e708-4e62-a811-739ee680035a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.193277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fd72f-e708-4e62-a811-739ee680035a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.212862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fd72f-e708-4e62-a811-739ee680035a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8d3fd72f-e708-4e62-a811-739ee680035a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:27.218294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:27.219210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:27.220660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 362/733] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:27.226352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ebac-f1f6-4d61-ab2e-f527a12bc23e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.226594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ebac-f1f6-4d61-ab2e-f527a12bc23e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.226874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0ebac-f1f6-4d61-ab2e-f527a12bc23e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.228470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 363/734] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:27.229172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0ebac-f1f6-4d61-ab2e-f527a12bc23e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.312360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d660e93-e3a7-4b5d-a58d-98684f21dc85 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:27.342071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0ebac-f1f6-4d61-ab2e-f527a12bc23e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:27.352413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741789f-3598-484c-8517-446ff85c4987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.353558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741789f-3598-484c-8517-446ff85c4987 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.354074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741789f-3598-484c-8517-446ff85c4987 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.354540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741789f-3598-484c-8517-446ff85c4987 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.363055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:27.364564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741789f-3598-484c-8517-446ff85c4987 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:27.366214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741789f-3598-484c-8517-446ff85c4987 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:27.378034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.378648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.378932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.379209 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.379913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:27.380265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-8741789f-3598-484c-8517-446ff85c4987 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:27.381098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:27.381974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:27.383061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:27.383607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:27.385774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 372/735] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:27.387201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fd696-7234-4532-adfd-0cbe6ef59093 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.387679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fd696-7234-4532-adfd-0cbe6ef59093 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.388178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fd696-7234-4532-adfd-0cbe6ef59093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.395380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 364/736] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:27.396348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.410620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e97fd696-7234-4532-adfd-0cbe6ef59093 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:27.412519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e97fd696-7234-4532-adfd-0cbe6ef59093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:27.497843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0c771-80e9-4e61-a427-00f8a4c7f740 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:27.516131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:27.542226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.543059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 373/737] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 18:58:27.544062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fd696-7234-4532-adfd-0cbe6ef59093 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.548041 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.548354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.548635 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.549399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:27.549709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:27.551150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:27.574676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 365/738] 10.222.0.82 () {56 vars in 1135 bytes} [Mon Aug 29 18:58:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:27.575571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.620945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:27.682866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2123-772b-41c2-916c-76cc55b01e33 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:27.683569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fd696-7234-4532-adfd-0cbe6ef59093 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:27.723932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eff46-dd72-4d82-a90d-fe9234bb66fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.724577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eff46-dd72-4d82-a90d-fe9234bb66fd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.724861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eff46-dd72-4d82-a90d-fe9234bb66fd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.725139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eff46-dd72-4d82-a90d-fe9234bb66fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.733452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.734339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.734822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.735743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.736008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eff46-dd72-4d82-a90d-fe9234bb66fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-144eff46-dd72-4d82-a90d-fe9234bb66fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:27.740924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:27.741851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:27.742685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 366/739] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:27.743373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eff46-dd72-4d82-a90d-fe9234bb66fd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.752376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:27.754645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:27.775080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:27.776114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:27.776985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:27.776985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:27.776985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:27.776985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 374/740] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:27.780518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.819290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:27.859339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:27.863406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eff46-dd72-4d82-a90d-fe9234bb66fd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:27.896159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b45b3-35d0-4d3a-a338-4863dda503c0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:27.899959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd19e-c6c9-4591-a306-c1c94aa942d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.900575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd19e-c6c9-4591-a306-c1c94aa942d0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.900857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd19e-c6c9-4591-a306-c1c94aa942d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.901135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fd19e-c6c9-4591-a306-c1c94aa942d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.937429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:27.938043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:27.938327 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:27.938640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:27.939405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:27.939742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:27.941115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:27.953835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 375/741] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:27.953835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:27.983563 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd19e-c6c9-4591-a306-c1c94aa942d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:27.985039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fd19e-c6c9-4591-a306-c1c94aa942d0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.045402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:28.055950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a2a60-38b0-47c2-ad2e-6fc94ce95e1f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.092400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:28.097747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 367/742] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:27 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 18:58:28.098572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd19e-c6c9-4591-a306-c1c94aa942d0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.103062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.104010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.104496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.104767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.109782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:28.109782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.109782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.119778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 376/743] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:28.124457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.215400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fd19e-c6c9-4591-a306-c1c94aa942d0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.237355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f5638-9434-40da-92a4-00d0ab7416a6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.254876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc473de2-4fdc-4183-83a4-848b9cbc7f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.255486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473de2-4fdc-4183-83a4-848b9cbc7f27 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.255789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473de2-4fdc-4183-83a4-848b9cbc7f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.256070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc473de2-4fdc-4183-83a4-848b9cbc7f27 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.256719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc473de2-4fdc-4183-83a4-848b9cbc7f27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.258213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc473de2-4fdc-4183-83a4-848b9cbc7f27 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.271783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.274652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.274652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.274652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.284787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.286212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:28.303308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:28.304529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:28.305515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:28.305515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:28.305515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:28.305515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 377/744] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:28.305515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.309674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:28.327615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 368/745] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:58:28 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:28.332336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc473de2-4fdc-4183-83a4-848b9cbc7f27 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.416585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:28.450496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062baa2-224d-48fb-a510-c32bcd78ff91 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.480854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc473de2-4fdc-4183-83a4-848b9cbc7f27 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.503347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.505203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.505734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.506391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.522197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.522973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.523764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.524678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.524962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.525233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.535914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.535914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:28.542317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:28.543261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:28.544229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:28.544229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:28.544229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:28.548507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 378/746] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:28.549482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:28.549674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:28.550556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:28.551535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 369/747] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:28.558823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.652149 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:28.665525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75927-9e33-4cfb-bb57-de1b337bf25c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.680423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7707e8-30d1-488c-bd03-c5f5b728e000 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.682324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:28.705603 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.706743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.707168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.707793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.709001 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:28.709696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.711783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.719294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.720008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.720580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.720828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.721566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:28.721794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.723171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.740238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 379/749] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:28.740238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.740660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 370/749] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:28.741959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.853618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d127a8-9c02-4190-93c3-0e08e4b22163 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.869973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:28.878548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa117f-f2af-4608-b2e4-7675209247fd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:28.893237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.893948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.894571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.894978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.895708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:28.896149 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.898197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.915171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 380/750] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:28.916465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:28.920004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:28.921622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:28.922082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:28.922551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:28.936382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:28.939420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:28.959539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:28.960560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:28.961457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:28.961457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:28.961457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:28.968476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 371/751] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:28.969712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.007633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:29.041784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754f82-474a-4a38-a305-9efe1f460d93 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.084274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.085189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.085613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.086026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.093401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.095192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.101168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a06d9d-b64e-4bff-b6b5-071d0c2435c4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:29.107569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:29.108682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:29.109737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:29.112138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 381/752] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:29.113100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.142916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ff8c1-90e5-4a73-8748-f182d5b7040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.143487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff8c1-90e5-4a73-8748-f182d5b7040a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.143791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff8c1-90e5-4a73-8748-f182d5b7040a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.144069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ff8c1-90e5-4a73-8748-f182d5b7040a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.151115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ff8c1-90e5-4a73-8748-f182d5b7040a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.152486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:29.152673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ff8c1-90e5-4a73-8748-f182d5b7040a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-8a3ff8c1-90e5-4a73-8748-f182d5b7040a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:29.168524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:29.169513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:29.170394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 372/753] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:29.171595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94525f-47f5-4a19-8a7e-13dd7b8b5510 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.171700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94525f-47f5-4a19-8a7e-13dd7b8b5510 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.171984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94525f-47f5-4a19-8a7e-13dd7b8b5510 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.173971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 373/754] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:29.176498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94525f-47f5-4a19-8a7e-13dd7b8b5510 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.233059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392628b4-91ba-4b1f-be3f-3a59d8a50bab None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.271524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb96009-c199-4b29-84d5-927c8352b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.272167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96009-c199-4b29-84d5-927c8352b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.272452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96009-c199-4b29-84d5-927c8352b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.272727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb96009-c199-4b29-84d5-927c8352b7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.273373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb96009-c199-4b29-84d5-927c8352b7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:29.273804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb96009-c199-4b29-84d5-927c8352b7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.275264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb96009-c199-4b29-84d5-927c8352b7a9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.277940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:29.290515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 382/755] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:29.291714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09784f-688f-42f8-8a18-7d52350ca396 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.292037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09784f-688f-42f8-8a18-7d52350ca396 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.292317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09784f-688f-42f8-8a18-7d52350ca396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.302530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94525f-47f5-4a19-8a7e-13dd7b8b5510 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.311573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1c09784f-688f-42f8-8a18-7d52350ca396 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:29.312795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1c09784f-688f-42f8-8a18-7d52350ca396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:29.341592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.342201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.342490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.342815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.343546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:29.343917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.345358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.363243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 374/756] 10.222.0.82 () {56 vars in 1149 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:29.364032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.403866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 383/757] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:29.405122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09784f-688f-42f8-8a18-7d52350ca396 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.445656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:29.477696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3137b3-fa66-49c9-b555-f40a2774bac4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.525158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.525785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.526072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.526353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.527058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:29.527373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.528862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.541162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09784f-688f-42f8-8a18-7d52350ca396 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.550339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 375/758] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:29.551323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.556003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:29.580668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.581606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.582097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.582551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.590321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.592070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:29.605440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:29.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:29.607227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:29.607227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:29.607227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:29.607227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:29.607227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:29.607227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:29.607227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:29.607227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:29.609613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 384/759] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:29.615812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.682195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72b096-af37-4217-881c-6b2c9724980e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.705583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:29.718920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9026d45-9f22-4048-b367-7131762a0ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.720483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9026d45-9f22-4048-b367-7131762a0ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.721027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9026d45-9f22-4048-b367-7131762a0ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.721350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9026d45-9f22-4048-b367-7131762a0ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.722862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de21fa-a977-4d6a-bdb3-e8c3ed8720fa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.759122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.760098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.760610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.760943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.761743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=209e9c8c1a0b41b58f51e94e4bd6c3ff) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:29.762050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.763527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.770658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 385/760] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/role_assignments?user.id=209e9c8c1a0b41b58f51e94e4bd6c3ff&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:29.771600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.811361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9026d45-9f22-4048-b367-7131762a0ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.813571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9026d45-9f22-4048-b367-7131762a0ea2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.818723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:29.910630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8345251-1ff4-4c23-af85-2fad1c372d56 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:29.948281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 376/761] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:58:29.948281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9026d45-9f22-4048-b367-7131762a0ea2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:29.973291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:29.973913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:29.974204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:29.974622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:29.975451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:29.975823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:29.977257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:29.991363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 386/762] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:29.992353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:30.011706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:30.075613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9026d45-9f22-4048-b367-7131762a0ea2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:30.079867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:30.122180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1eb71-2ca4-4212-9978-19b3c71cf04d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:30.123584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:30.124280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.124728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.127504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.127504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:30.127836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:30.139831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:30.140858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:30.142339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 377/763] 10.222.0.82 () {56 vars in 1129 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:30.143170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:30.181872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:30.182573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.182974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.183261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.199433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:30.203061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:30.223757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:30.225068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:30.225969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:30.225969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:30.225969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:30.225969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 387/764] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:30.226201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:30.272795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f098bb80-7d6b-41a9-9c6c-3b50ca11aba0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:30.306429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:30.315771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea0deb-75f7-4f84-813a-997642b9dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:30.322556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0deb-75f7-4f84-813a-997642b9dcba None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.322556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0deb-75f7-4f84-813a-997642b9dcba None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.322556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea0deb-75f7-4f84-813a-997642b9dcba None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/e02a03585caf46fdb09b4a2fdde91a51/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.322556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea0deb-75f7-4f84-813a-997642b9dcba None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=e02a03585caf46fdb09b4a2fdde91a51, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:30.322556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea0deb-75f7-4f84-813a-997642b9dcba None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:30.351579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b818e5-c608-433c-b8fb-f97de54240de None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:30.393157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:30.393773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.394056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.394340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.394983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:30.395290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:30.396694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:30.401950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 388/765] 10.222.0.82 () {56 vars in 1124 bytes} [Mon Aug 29 18:58:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:30.402740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:30.418417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 378/766] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:30 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/e02a03585caf46fdb09b4a2fdde91a51/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:30.420042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6771c0-eefb-4b81-b6ac-25c342b7003a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.420714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6771c0-eefb-4b81-b6ac-25c342b7003a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.421220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6771c0-eefb-4b81-b6ac-25c342b7003a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.423309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 379/767] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:30.424523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6771c0-eefb-4b81-b6ac-25c342b7003a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:30.461570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:30.550545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73557781-2632-44fa-8c40-da5ebcab7bf7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:30.554492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6771c0-eefb-4b81-b6ac-25c342b7003a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:30.580809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:30.593116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:30.593886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.594172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.594448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.595673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:30.596182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:30.598059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:30.598166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c5703-78c0-47e1-8aec-4f446e7defb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:30.598621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5703-78c0-47e1-8aec-4f446e7defb5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.599043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5703-78c0-47e1-8aec-4f446e7defb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.599234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c5703-78c0-47e1-8aec-4f446e7defb5 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.601059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c5703-78c0-47e1-8aec-4f446e7defb5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:30.601059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c5703-78c0-47e1-8aec-4f446e7defb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:30.601489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c5703-78c0-47e1-8aec-4f446e7defb5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:30.610601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 380/768] 10.222.0.82 () {56 vars in 1124 bytes} [Mon Aug 29 18:58:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:30.611916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b08b4-ae68-4fb2-a10d-d87ec1ad4293 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.612136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b08b4-ae68-4fb2-a10d-d87ec1ad4293 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.612422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b08b4-ae68-4fb2-a10d-d87ec1ad4293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.614973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 389/769] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:30.616520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:30.632778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ae4b08b4-ae68-4fb2-a10d-d87ec1ad4293 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:30.633995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ae4b08b4-ae68-4fb2-a10d-d87ec1ad4293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:30.706319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 381/770] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:30.707301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b08b4-ae68-4fb2-a10d-d87ec1ad4293 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:30.732627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:30.747299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002786f6-52ac-4251-b7ca-dc86c670584d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:30.788056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:30.789025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.789570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.790052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.790963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] RBAC: Adding query filter params (interface=public, service_id=ffb865429d5347eeaf63631b75b81984, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:30.791504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:30.793269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:30.803263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 390/771] 10.222.0.82 () {56 vars in 1251 bytes} [Mon Aug 29 18:58:30 2022] GET /identity/v3/endpoints?service_id=ffb865429d5347eeaf63631b75b81984&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:30.808509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:30.887251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b08b4-ae68-4fb2-a10d-d87ec1ad4293 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:30.926374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:30.927413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:30.927948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:30.928448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:30.936165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:30.937988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:30.951342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:30.952316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:30.953214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:30.953214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:30.953214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:30.953214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:30.953214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:30.953214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:30.953214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:30.953214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:30.956799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 382/772] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:30.959832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:30.964148 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:31.052704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aac04-2c85-42e8-8b7f-dcce6c29ef05 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:31.074304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:31.088223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f1462-7fae-42aa-82c2-8a01f657a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:31.089103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f1462-7fae-42aa-82c2-8a01f657a852 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.089103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f1462-7fae-42aa-82c2-8a01f657a852 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.089368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f1462-7fae-42aa-82c2-8a01f657a852 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.089986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f1462-7fae-42aa-82c2-8a01f657a852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:31.091409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f1462-7fae-42aa-82c2-8a01f657a852 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:31.096845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 391/773] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 18:58:30 2022] GET /identity/v3/services => generated 772 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:31.097705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f1462-7fae-42aa-82c2-8a01f657a852 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:31.099193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9342-f8c8-45dd-b2e1-4a141287b262 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:31.151696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:31.152748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.153238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.153724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.154647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:31.155191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:31.156951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:31.171249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 383/774] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:31.180743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:31.211810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f1462-7fae-42aa-82c2-8a01f657a852 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:31.228123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:31.258299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:31.258962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.259248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.267025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] PATH_INFO: `/v3/services/network` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.267025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:31.267025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:31.279565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:31.280852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:31.281851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:31.288781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 392/775] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:31 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:31.291566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:31.361807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b7ede-d1fa-4031-a06b-cc9dac829092 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:31.399188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:31.400025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.400240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.400609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.401354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=59e8a8c6ca7549238eeab1a5ad74f896) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:31.401668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:31.403080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:31.403623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ad18f-04a4-4cea-88d2-6582c852cd43 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:31.409386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 384/776] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:31 2022] GET /identity/v3/role_assignments?user.id=59e8a8c6ca7549238eeab1a5ad74f896&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:31.450344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:31.451002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.451290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.451569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.452260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] RBAC: Adding query filter params (name=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:31.452572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:31.454061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:31.459651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 393/777] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:31.465149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:31.479795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:31.617932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ea86-5517-431f-bdca-deadd4f5475c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:31.661216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:31.661846 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.662130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.662407 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.663053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] RBAC: Adding query filter params (type=network) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:31.663360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:31.664814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:31.670401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 385/778] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:31.680845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:31.731406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:31.815899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5276e53a-81c8-48a9-9576-e72d3beca23d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:31.853797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bf92a-dadd-427f-bf5e-84e75d87c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:31.854424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bf92a-dadd-427f-bf5e-84e75d87c13c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.854709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bf92a-dadd-427f-bf5e-84e75d87c13c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.855052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bf92a-dadd-427f-bf5e-84e75d87c13c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.855810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bf92a-dadd-427f-bf5e-84e75d87c13c None admin] RBAC: Adding query filter params (interface=public, service_id=909e063a77a144eca07676b8e8f09131, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:31.856130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bf92a-dadd-427f-bf5e-84e75d87c13c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:31.857509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bf92a-dadd-427f-bf5e-84e75d87c13c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:31.863659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 394/779] 10.222.0.82 () {56 vars in 1251 bytes} [Mon Aug 29 18:58:31 2022] GET /identity/v3/endpoints?service_id=909e063a77a144eca07676b8e8f09131&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:31.868821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:31.969154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5eb88-1654-425f-9c25-3247ace6f60d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.969596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5eb88-1654-425f-9c25-3247ace6f60d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.970532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5eb88-1654-425f-9c25-3247ace6f60d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.972710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 395/780] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:31.981341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5982-3acd-4400-a850-9629c0a2b323 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:31.981631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5982-3acd-4400-a850-9629c0a2b323 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:31.981909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb5982-3acd-4400-a850-9629c0a2b323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:31.982288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:32.017416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9b945-8cc7-4aa9-8f6a-971cddb79c03 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:32.028732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-acfb5982-3acd-4400-a850-9629c0a2b323 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:32.029946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-acfb5982-3acd-4400-a850-9629c0a2b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:32.062885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f5579-ea40-46c6-be92-e8f229e0d131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:32.065154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5579-ea40-46c6-be92-e8f229e0d131 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:32.065836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5579-ea40-46c6-be92-e8f229e0d131 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:32.067209 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f5579-ea40-46c6-be92-e8f229e0d131 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:32.068065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f5579-ea40-46c6-be92-e8f229e0d131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:32.071681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f5579-ea40-46c6-be92-e8f229e0d131 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:32.080331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 386/781] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 18:58:31 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:32.154037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 396/782] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:32.450249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f5579-ea40-46c6-be92-e8f229e0d131 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:32.583452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f5579-ea40-46c6-be92-e8f229e0d131 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:32.632654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90917632-dbaa-49f1-adc3-72de1bc7659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:32.633306 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917632-dbaa-49f1-adc3-72de1bc7659b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:32.633588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917632-dbaa-49f1-adc3-72de1bc7659b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:32.633865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917632-dbaa-49f1-adc3-72de1bc7659b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:32.635773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:32.652652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90917632-dbaa-49f1-adc3-72de1bc7659b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-90917632-dbaa-49f1-adc3-72de1bc7659b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:32.658169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:32.659064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:32.659951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 387/783] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:32.669035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb5982-3acd-4400-a850-9629c0a2b323 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:32.727502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:32.799189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ff67-b9ca-4f8b-8156-be559e8d8375 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:32.799478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ff67-b9ca-4f8b-8156-be559e8d8375 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:32.799801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342ff67-b9ca-4f8b-8156-be559e8d8375 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:32.802410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 388/784] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:32.806421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae4ad-28b1-4d6d-aa2c-e88f40b9e6cd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:32.806709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae4ad-28b1-4d6d-aa2c-e88f40b9e6cd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:32.806992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae4ad-28b1-4d6d-aa2c-e88f40b9e6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:32.825587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ce0ae4ad-28b1-4d6d-aa2c-e88f40b9e6cd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:32.826801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ce0ae4ad-28b1-4d6d-aa2c-e88f40b9e6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:32.831160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb5982-3acd-4400-a850-9629c0a2b323 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:32.893998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:32.894952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:32.895620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:32.896270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:32.897523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:32.897985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:32.899581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:32.903844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 389/785] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:32.910309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 397/786] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:32.916169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae4ad-28b1-4d6d-aa2c-e88f40b9e6cd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:33.067552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae4ad-28b1-4d6d-aa2c-e88f40b9e6cd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:33.092445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:33.104779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:33.105689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:33.109141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:33.109141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:33.117917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:33.119621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:33.135641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:33.136628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:33.137499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:33.137499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:33.137499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:33.139517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 390/787] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:33.145617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:33.254028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:33.281595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:33.290225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40b25e-f1cd-4c1c-8094-3b65d64f73a6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:33.350865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:33.352706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:33.353217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:33.354455 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:33.355472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:33.358080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:33.362312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:33.385010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 398/788] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:33.387284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b68d8-d333-4bb9-bdc4-0cbc06365074 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:33.390040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:33.476880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c40cf-4b69-4816-afca-24bd16027f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:33.477973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c40cf-4b69-4816-afca-24bd16027f48 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:33.478464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c40cf-4b69-4816-afca-24bd16027f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:33.478962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c40cf-4b69-4816-afca-24bd16027f48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:33.501880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c40cf-4b69-4816-afca-24bd16027f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-949c40cf-4b69-4816-afca-24bd16027f48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:33.510119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:33.511031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:33.511926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:33.522287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 391/789] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:33.524844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c40cf-4b69-4816-afca-24bd16027f48 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:33.553621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4efe-b3cf-4364-b944-3d011d1830aa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:33.596813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:33.616458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ca62e-c183-41a3-9b64-0f7ebec44d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:33.617161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca62e-c183-41a3-9b64-0f7ebec44d00 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:33.617446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca62e-c183-41a3-9b64-0f7ebec44d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:33.617724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca62e-c183-41a3-9b64-0f7ebec44d00 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:33.629896 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ca62e-c183-41a3-9b64-0f7ebec44d00 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:33.631744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ca62e-c183-41a3-9b64-0f7ebec44d00 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b64ca62e-c183-41a3-9b64-0f7ebec44d00 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:33.647013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:33.648062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:33.649024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 399/790] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:33.649618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090532a-3890-46a2-b286-9b5c03984c90 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:33.649938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090532a-3890-46a2-b286-9b5c03984c90 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:33.650147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090532a-3890-46a2-b286-9b5c03984c90 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:33.656215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 400/791] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:33.657055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090532a-3890-46a2-b286-9b5c03984c90 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:33.674610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c40cf-4b69-4816-afca-24bd16027f48 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:33.677589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:33.781929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090532a-3890-46a2-b286-9b5c03984c90 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:33.827600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950243f7-a7d4-46d8-9954-0576cec12b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:33.828531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950243f7-a7d4-46d8-9954-0576cec12b52 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:33.829061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950243f7-a7d4-46d8-9954-0576cec12b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:33.829584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950243f7-a7d4-46d8-9954-0576cec12b52 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:33.830752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950243f7-a7d4-46d8-9954-0576cec12b52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:33.831237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950243f7-a7d4-46d8-9954-0576cec12b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:33.833269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950243f7-a7d4-46d8-9954-0576cec12b52 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:33.841669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:33.842864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:33.843370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:33.845472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:33.846899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:33.847433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:33.849434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:33.858688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 401/792] 10.222.0.82 () {56 vars in 1135 bytes} [Mon Aug 29 18:58:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:33.858688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46879726-312e-444c-af1d-65ba1fae963c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:33.858688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46879726-312e-444c-af1d-65ba1fae963c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:33.858688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46879726-312e-444c-af1d-65ba1fae963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:33.867778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 392/793] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:33.868832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:33.877817 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-46879726-312e-444c-af1d-65ba1fae963c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:33.879100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-46879726-312e-444c-af1d-65ba1fae963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:33.970686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 402/794] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:33.971629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46879726-312e-444c-af1d-65ba1fae963c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:33.977116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:34.007206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:34.011212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e3056-d3b3-4dd4-ae3b-f269263041ab None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.048323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a5e09-5885-4bbb-b539-236ae8671a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.049178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5e09-5885-4bbb-b539-236ae8671a37 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.049280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5e09-5885-4bbb-b539-236ae8671a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.049534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a5e09-5885-4bbb-b539-236ae8671a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.061110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a5e09-5885-4bbb-b539-236ae8671a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.062777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a5e09-5885-4bbb-b539-236ae8671a37 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-767a5e09-5885-4bbb-b539-236ae8671a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:34.090091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:34.091104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:34.092281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:34.092281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:34.092281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:34.096873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 393/795] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:34.098515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124177-7cf1-402e-92c7-f64ba500b646 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.098823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124177-7cf1-402e-92c7-f64ba500b646 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.099681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6124177-7cf1-402e-92c7-f64ba500b646 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.100835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 394/796] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:34.106561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124177-7cf1-402e-92c7-f64ba500b646 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.136966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46879726-312e-444c-af1d-65ba1fae963c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.175502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac628c-3f49-4747-a8e3-769f8e6a19a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.176534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac628c-3f49-4747-a8e3-769f8e6a19a1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.177128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac628c-3f49-4747-a8e3-769f8e6a19a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.177633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac628c-3f49-4747-a8e3-769f8e6a19a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.189630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac628c-3f49-4747-a8e3-769f8e6a19a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.191398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ac628c-3f49-4747-a8e3-769f8e6a19a1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-99ac628c-3f49-4747-a8e3-769f8e6a19a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:34.208204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:34.209552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:34.211078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:34.211078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:34.211078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:34.213035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 403/797] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:34.214464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad411a-a091-41fa-974f-dcf939aaeaa3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.214892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad411a-a091-41fa-974f-dcf939aaeaa3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.215348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad411a-a091-41fa-974f-dcf939aaeaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.216960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6124177-7cf1-402e-92c7-f64ba500b646 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.234914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f0ad411a-a091-41fa-974f-dcf939aaeaa3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:34.237133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f0ad411a-a091-41fa-974f-dcf939aaeaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:34.253948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.254657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.254934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.255204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.255886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:34.256186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.257534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.274793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 395/798] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:34.275572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.288683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:34.297168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:34.317118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 404/799] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:34.318794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad411a-a091-41fa-974f-dcf939aaeaa3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.396942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6979-d175-46dd-aa36-2ea3144d0647 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.435574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad411a-a091-41fa-974f-dcf939aaeaa3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.442710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.443629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.444311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.444741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.445799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:34.446280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.448031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.461749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 396/800] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:34.463430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.474134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.474848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.475274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.476033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.487011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.490167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:34.502205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:34.503102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:34.504121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:34.504121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:34.504121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:34.504121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:34.504121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:34.504121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:34.504121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:34.504121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:34.508243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 405/801] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:34.509545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.546871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:34.559165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:34.581582 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff8a42-7154-43e4-af27-1881d7af1c3a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.618847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.619097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3b67b-70c4-4ba8-a6af-1c659e0182b4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.619907 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.620365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.620843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.621713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.623076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:34.633152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:34.634203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:34.636665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 397/802] 10.222.0.82 () {56 vars in 1129 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:34.637484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.659046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.659629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.659954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.660223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.668574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.670309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:34.683109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:34.684293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 406/803] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:34.685401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.741098 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc1a99-56ab-42ff-90b9-77f7489c00a4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.774473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.775072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.775352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.775625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.776341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:34.776639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.778051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.779572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:34.785173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f774e3-9f43-4ee4-96e1-21bc3e0c2d75 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.790280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 398/804] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:34.791119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.792604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:34.823254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57ee0-5358-430e-b16b-af741c192e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.823918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57ee0-5358-430e-b16b-af741c192e18 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.824207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57ee0-5358-430e-b16b-af741c192e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.824487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57ee0-5358-430e-b16b-af741c192e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.835404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea57ee0-5358-430e-b16b-af741c192e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-dea57ee0-5358-430e-b16b-af741c192e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:34.840623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:34.841580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:34.842421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 407/805] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:34.843109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f63c-e399-47a8-baac-f9abeb9af45c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.843418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f63c-e399-47a8-baac-f9abeb9af45c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.843771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f63c-e399-47a8-baac-f9abeb9af45c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.844969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 408/806] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:34.845669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f63c-e399-47a8-baac-f9abeb9af45c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.894867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ea53a-4ed3-4378-9d29-3278906778e5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.931833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.932346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.932632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.932910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.933533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:34.933838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.935177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:34.940894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 399/807] 10.222.0.82 () {56 vars in 1124 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:34.941646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:34.950419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f63c-e399-47a8-baac-f9abeb9af45c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:34.984014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:34.984613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:34.984889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:34.985716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:34.986437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:34.986741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:34.988186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.000017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:35.005857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 409/808] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:58:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:35.006651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:35.031281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:35.041990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ac51a-c813-4948-ad0f-378507befd2f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:35.077488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d7275-5484-4a22-ba06-84b224958b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:35.078141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7275-5484-4a22-ba06-84b224958b10 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.078418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7275-5484-4a22-ba06-84b224958b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.078691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7275-5484-4a22-ba06-84b224958b10 None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/209e9c8c1a0b41b58f51e94e4bd6c3ff/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.080853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d7275-5484-4a22-ba06-84b224958b10 None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=209e9c8c1a0b41b58f51e94e4bd6c3ff, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:35.082253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d7275-5484-4a22-ba06-84b224958b10 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.107836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278795d-2f8a-4dda-9af8-7bae534d3225 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:35.142397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:35.143009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.143301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.143574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.144283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:35.144587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:35.145967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.152896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 400/809] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:34 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/209e9c8c1a0b41b58f51e94e4bd6c3ff/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:35.154749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b355-0dee-464d-8ba1-7a252e1b4b0a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.155038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b355-0dee-464d-8ba1-7a252e1b4b0a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.155378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096b355-0dee-464d-8ba1-7a252e1b4b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.160495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 410/810] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:35.160495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:35.176338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8096b355-0dee-464d-8ba1-7a252e1b4b0a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:35.177628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8096b355-0dee-464d-8ba1-7a252e1b4b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:35.260283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 401/811] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:35.261383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096b355-0dee-464d-8ba1-7a252e1b4b0a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:35.277331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:35.299952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1dcac-184f-4020-a06c-efb4bbbe7d1d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:35.327657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:35.357369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:35.358046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.358336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.359145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.359848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:35.360185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:35.362079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.369577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 411/812] 10.222.0.82 () {56 vars in 1124 bytes} [Mon Aug 29 18:58:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:35.376260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:35.389853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096b355-0dee-464d-8ba1-7a252e1b4b0a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:35.430927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346096-133a-4885-8e03-1e6743b0c1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:35.431938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346096-133a-4885-8e03-1e6743b0c1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.432447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346096-133a-4885-8e03-1e6743b0c1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.432997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33346096-133a-4885-8e03-1e6743b0c1c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.516453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33346096-133a-4885-8e03-1e6743b0c1c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:35.517767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e52a8-44df-4ca0-a1de-624904d3c6bb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:35.518780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33346096-133a-4885-8e03-1e6743b0c1c5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.562434 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592644-bee4-4401-8503-afab723d5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:35.563076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592644-bee4-4401-8503-afab723d5281 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.563394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592644-bee4-4401-8503-afab723d5281 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.563671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70592644-bee4-4401-8503-afab723d5281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.573048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:35.575110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70592644-bee4-4401-8503-afab723d5281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:35.576594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70592644-bee4-4401-8503-afab723d5281 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-70592644-bee4-4401-8503-afab723d5281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:35.592503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:35.593507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:35.594448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:35.594448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:35.594448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:35.594448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 412/813] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:35.594448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592644-bee4-4401-8503-afab723d5281 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:35.602253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:35.636016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 402/814] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:58:35.637161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346096-133a-4885-8e03-1e6743b0c1c5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:35.717934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70592644-bee4-4401-8503-afab723d5281 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:35.749100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33346096-133a-4885-8e03-1e6743b0c1c5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:35.756119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598112b-ed1a-4615-8269-37bd5845fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:35.756728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598112b-ed1a-4615-8269-37bd5845fb02 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.757008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598112b-ed1a-4615-8269-37bd5845fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.757279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598112b-ed1a-4615-8269-37bd5845fb02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.757942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598112b-ed1a-4615-8269-37bd5845fb02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:35.759303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598112b-ed1a-4615-8269-37bd5845fb02 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.786375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:35.786561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.786751 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.787024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.787602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:35.788982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:35.798176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:35.799444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:35.800429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 403/815] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:35 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:35.801293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:35.827123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:35.888022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 413/816] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 18:58:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:35.889769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598112b-ed1a-4615-8269-37bd5845fb02 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:35.930824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c8d2-a3f6-4bd8-90fe-d000338da9f1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:35.986702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:35.987325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:35.987610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:35.987932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:35.988587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:35.988950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:35.991329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:35.997286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:36.011770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 404/817] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:36.011770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.057707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598112b-ed1a-4615-8269-37bd5845fb02 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.093071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:36.098652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.099344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.099630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.099948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.112261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.113727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:36.132172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:36.133234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:36.134775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:36.134775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:36.134775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:36.134775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 414/818] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:36.137092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.150079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd047d4-1d05-4986-9034-369cda76baa0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.195847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.196975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.197410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.197858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.198637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] RBAC: Adding query filter params (name=network) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:36.199164 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.205034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.217102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 405/819] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:36.217102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.264078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d95e32-7f9b-4822-a1c8-5e460f8fbcd6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.276584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:36.302644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.303685 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.304215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.304758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.314536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.316562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:36.330580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:36.331667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:36.332654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:36.335243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 415/820] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:36.336438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.347966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2ee66-a5c6-403b-9157-0eab8672b63c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.381274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:36.386548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.387419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.387959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.388559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.389414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:36.389956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.391680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.409458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 406/821] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:36.410693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.468214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84395df6-7bf9-4874-a746-43701836fe72 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.513708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.514357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.514637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.515196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.515917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] RBAC: Adding query filter params (type=network) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:36.516251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.517972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.529177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 416/822] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:36.529177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.530087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d183125-bd37-4ac9-ad11-2c5ea0a0a519 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.567838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:36.568013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.568951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.569437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.569913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.571119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:36.571681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.573360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.592555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 407/823] 10.222.0.82 () {56 vars in 1149 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:36.593909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.650670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:36.653341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518885a-8384-4a6a-90dc-32f11f5dcd8a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.699074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.699879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.700165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.700440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.706150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b607e1-c7f4-4c83-9418-f1bdd924226d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.710814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.712285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:36.727993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:36.728965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:36.729856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:36.729856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:36.729856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:36.729856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:36.729856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:36.729856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:36.729856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:36.729856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:36.735410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 417/824] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:36.735410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.758236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7af11-6b52-4747-9152-c0681860166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.758856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7af11-6b52-4747-9152-c0681860166b None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.759138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7af11-6b52-4747-9152-c0681860166b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.759409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7af11-6b52-4747-9152-c0681860166b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.760139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7af11-6b52-4747-9152-c0681860166b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.762080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7af11-6b52-4747-9152-c0681860166b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.839021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:36.846203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df6864-8287-490d-b8b2-1afb7c072dcc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:36.884253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 408/825] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 18:58:36 2022] POST /identity/v3/endpoints => generated 337 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:36.886040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7af11-6b52-4747-9152-c0681860166b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:36.908088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:36.909999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:36.909999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:36.909999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:36.944741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:36.946975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:36.980547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:36.981580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:36.982493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:36.982493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:36.982493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:36.990742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 418/826] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:36.991818 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:37.074147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7af11-6b52-4747-9152-c0681860166b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:37.085897 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:37.117294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15703046-19f3-41d8-8b0e-c8748aaec1ff None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:37.137957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:37.139475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.139964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.141971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.141971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:37.142674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:37.144555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:37.160317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 409/827] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:37.168631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:37.170911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:37.171533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.171852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.172130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.172900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:37.173150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:37.175022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:37.192015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 419/828] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:37.204472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:37.207925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:37.301732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be854a3-a5a8-43b3-ab6f-514a64ad931c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:37.341942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71092817-7618-48b6-9d2b-b18d70743a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:37.342550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71092817-7618-48b6-9d2b-b18d70743a89 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.342834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71092817-7618-48b6-9d2b-b18d70743a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.343108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71092817-7618-48b6-9d2b-b18d70743a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.343282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1cd0c1-6cbd-45f8-b828-f89634a9bee8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:37.343866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71092817-7618-48b6-9d2b-b18d70743a89 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=e02a03585caf46fdb09b4a2fdde91a51) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:37.344182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71092817-7618-48b6-9d2b-b18d70743a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:37.346398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71092817-7618-48b6-9d2b-b18d70743a89 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:37.352265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 410/829] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:37 2022] GET /identity/v3/role_assignments?user.id=e02a03585caf46fdb09b4a2fdde91a51&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:37.353442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d6733-14a3-434b-b8c1-af4cca4214bd None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.353730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d6733-14a3-434b-b8c1-af4cca4214bd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.354008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d6733-14a3-434b-b8c1-af4cca4214bd None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.355364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 411/830] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:37.362040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c24c2a-6fcf-4efd-9ab2-377a06e710b7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.362873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c24c2a-6fcf-4efd-9ab2-377a06e710b7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.363492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c24c2a-6fcf-4efd-9ab2-377a06e710b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.384059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-86c24c2a-6fcf-4efd-9ab2-377a06e710b7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:37.385456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-86c24c2a-6fcf-4efd-9ab2-377a06e710b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:37.391967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:37.392882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.393319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.393749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.402509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:37.404429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:37.414678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:37.418850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:37.419969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:37.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:37.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:37.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:37.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:37.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:37.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:37.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:37.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:37.423781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 420/831] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:37.429417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:37.479076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 412/832] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:37.518303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:37.560905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3eb43f-002e-4876-92d2-e3e6f114b3e6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:37.606489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:37.606489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.606489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.606489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.606944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:37.606944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:37.606944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:37.619339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 421/833] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:37.625352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c24c2a-6fcf-4efd-9ab2-377a06e710b7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:37.734033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c24c2a-6fcf-4efd-9ab2-377a06e710b7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:37.770188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bd7e5-1d6e-4b55-8beb-30f51c701697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:37.770864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bd7e5-1d6e-4b55-8beb-30f51c701697 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.771147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bd7e5-1d6e-4b55-8beb-30f51c701697 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.771424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bd7e5-1d6e-4b55-8beb-30f51c701697 None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/59e8a8c6ca7549238eeab1a5ad74f896/roles/d0a36a8f7b0a40d784c17d608a72047e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.774409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:37.790822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bd7e5-1d6e-4b55-8beb-30f51c701697 None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=59e8a8c6ca7549238eeab1a5ad74f896, role_id=d0a36a8f7b0a40d784c17d608a72047e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:37.792820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bd7e5-1d6e-4b55-8beb-30f51c701697 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:37.885346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d179636-051c-4cd5-ac2a-c5792a216a2e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:37.889391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 413/834] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:37 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/59e8a8c6ca7549238eeab1a5ad74f896/roles/d0a36a8f7b0a40d784c17d608a72047e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:37.913962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:37.926944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828aeab-fe71-4337-9502-411dbfc3cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:37.927606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828aeab-fe71-4337-9502-411dbfc3cf1c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.927923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828aeab-fe71-4337-9502-411dbfc3cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.928206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828aeab-fe71-4337-9502-411dbfc3cf1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.940200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828aeab-fe71-4337-9502-411dbfc3cf1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4828aeab-fe71-4337-9502-411dbfc3cf1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:37.945583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:37.946564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:37.947411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 422/835] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:37.953469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bd7e5-1d6e-4b55-8beb-30f51c701697 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:37.971662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:37.980392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38e468-6133-412e-a599-f8ed47725546 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.980976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38e468-6133-412e-a599-f8ed47725546 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.981421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a38e468-6133-412e-a599-f8ed47725546 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:37.983906 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 423/836] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:37.991528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730128-2cd2-4f02-b7e1-059c2d75933b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:37.991769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730128-2cd2-4f02-b7e1-059c2d75933b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:37.992017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730128-2cd2-4f02-b7e1-059c2d75933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.018744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-35730128-2cd2-4f02-b7e1-059c2d75933b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:38.020451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-35730128-2cd2-4f02-b7e1-059c2d75933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:38.092484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bd7e5-1d6e-4b55-8beb-30f51c701697 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:38.123834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 424/837] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:38.133760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:38.134505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:38.134890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:38.135268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.136169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:38.136576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:38.138102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:38.151109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 414/838] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:38.156410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35730128-2cd2-4f02-b7e1-059c2d75933b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:38.266032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35730128-2cd2-4f02-b7e1-059c2d75933b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:38.286044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:38.308764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:38.309403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:38.309687 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:38.309965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.321534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:38.322984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:38.339527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:38.340541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:38.341448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:38.341448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:38.341448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:38.341448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 425/839] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:38.348037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:38.396760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:38.424233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:38.457136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2916e83-db93-41a7-9c82-224ad70007c3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:38.496635 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:38.497372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:38.497655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:38.497933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.498586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:38.498896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:38.500339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:38.512861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7ecbf-7313-41c5-9c3e-ab890f76b5d3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:38.519917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 415/840] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:38.520795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:38.556915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:38.557611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:38.557897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:38.558173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.558821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:38.560446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:38.572641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:38.573698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:38.574625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 426/841] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:38.580315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:38.618517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:38.641151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57497125-0b13-402e-b324-db948f9c68fa None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:38.680939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:38.687200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:38.688270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:38.688569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:38.688842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.698734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:38.700617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:38.714650 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c232cf2-977c-4d26-8a25-4df27a11a94c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:38.721346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:38.722305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 18:58:38.723235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:38.727745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 416/842] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:58:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:38.728575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:38.756791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:38.757789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:38.758311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:38.758909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.759870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:38.760384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:38.762059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:38.767940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 427/843] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:38.779918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:38.851444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebec007-72f2-4f88-b06c-112075d5f086 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:38.888560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae70ff-4651-4e6e-ab86-54aa1b72808e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:38.891089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:38.892107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:38.892740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:38.893243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:38.893745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.894714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:38.895226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:38.896989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:38.916885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 417/844] 10.222.0.82 () {56 vars in 1135 bytes} [Mon Aug 29 18:58:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:38.923333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:38.936450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:38.937099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:38.937385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:38.937664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:38.939401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:38.939838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:38.941508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:38.948588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 428/845] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:38.994324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:39.046435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc6654-e574-4237-9c8b-4a6e2a694d69 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:39.085669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13e4e0-a8fb-4f01-94d0-472e728f5dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:39.086297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13e4e0-a8fb-4f01-94d0-472e728f5dca None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:39.086580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13e4e0-a8fb-4f01-94d0-472e728f5dca None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:39.086856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13e4e0-a8fb-4f01-94d0-472e728f5dca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:39.169084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13e4e0-a8fb-4f01-94d0-472e728f5dca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:39.171195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13e4e0-a8fb-4f01-94d0-472e728f5dca None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:39.232051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:39.275357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 418/846] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:58:39.280997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:39.390518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1790da-a7e1-40f3-8584-2de871e59ab9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:39.427449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae83f9-5cdd-444c-886e-8ccd41418e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:39.431846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae83f9-5cdd-444c-886e-8ccd41418e9e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:39.431846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae83f9-5cdd-444c-886e-8ccd41418e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:39.431846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae83f9-5cdd-444c-886e-8ccd41418e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:39.441491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae83f9-5cdd-444c-886e-8ccd41418e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:39.442967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae83f9-5cdd-444c-886e-8ccd41418e9e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5aae83f9-5cdd-444c-886e-8ccd41418e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:39.459132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:39.460167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:39.461081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:39.461081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:39.461081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:39.461081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 429/847] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:39.466317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13e4e0-a8fb-4f01-94d0-472e728f5dca None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:39.486110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2614799-12f9-47f3-b367-b80873ff442c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:39.486521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2614799-12f9-47f3-b367-b80873ff442c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:39.486834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2614799-12f9-47f3-b367-b80873ff442c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:39.488770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 430/848] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:39.496728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee597-0661-41d6-9477-41dff5feff98 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:39.497015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee597-0661-41d6-9477-41dff5feff98 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:39.497294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ee597-0661-41d6-9477-41dff5feff98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:39.522220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e54ee597-0661-41d6-9477-41dff5feff98 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:39.524129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e54ee597-0661-41d6-9477-41dff5feff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:39.527992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:39.582769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13e4e0-a8fb-4f01-94d0-472e728f5dca None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:39.615874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 431/849] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:39.627649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:39.628612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:39.629104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:39.629580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:39.630488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:39.631091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:39.632696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:39.646006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 419/850] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:39.653608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ee597-0661-41d6-9477-41dff5feff98 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:39.759514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ee597-0661-41d6-9477-41dff5feff98 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:39.795123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:39.795819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:39.796065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:39.796344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:39.803867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:39.805317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:39.807116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:39.817295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:39.824078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:39.824977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 432/851] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:39.825575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:39.838724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:39.915364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:39.934188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca60bab-0f28-4b6e-963c-aeb427153d13 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:39.982523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9347fc-241c-4131-9f1b-c7dce0085e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:39.983340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9347fc-241c-4131-9f1b-c7dce0085e2e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:39.983636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9347fc-241c-4131-9f1b-c7dce0085e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:39.983976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9347fc-241c-4131-9f1b-c7dce0085e2e None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:39.985947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9347fc-241c-4131-9f1b-c7dce0085e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:39.986274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9347fc-241c-4131-9f1b-c7dce0085e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:39.988461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9347fc-241c-4131-9f1b-c7dce0085e2e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:40.005310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 420/852] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:40.006521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d841-7a19-40ba-acb1-89eb01ccb684 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.006815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d841-7a19-40ba-acb1-89eb01ccb684 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.007090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7d841-7a19-40ba-acb1-89eb01ccb684 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:40.008617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 421/853] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:40.013178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d841-7a19-40ba-acb1-89eb01ccb684 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:40.030776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0149dc-4805-42d3-89e1-4350bcf2f76f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:40.072973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db028b4-3d67-4d93-b0b8-95511f890ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:40.073770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db028b4-3d67-4d93-b0b8-95511f890ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.074048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db028b4-3d67-4d93-b0b8-95511f890ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.074700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db028b4-3d67-4d93-b0b8-95511f890ac3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:40.075297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db028b4-3d67-4d93-b0b8-95511f890ac3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:40.076695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db028b4-3d67-4d93-b0b8-95511f890ac3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9db028b4-3d67-4d93-b0b8-95511f890ac3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:40.086435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:40.088433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:40.089463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 433/854] 10.222.0.82 () {56 vars in 1132 bytes} [Mon Aug 29 18:58:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:40.090612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64bcc-b7e1-4c5d-8998-0c335c22b4b8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.090612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64bcc-b7e1-4c5d-8998-0c335c22b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.090612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64bcc-b7e1-4c5d-8998-0c335c22b4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:40.108124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:40.108314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e4a64bcc-b7e1-4c5d-8998-0c335c22b4b8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:40.109518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e4a64bcc-b7e1-4c5d-8998-0c335c22b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:40.143921 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7d841-7a19-40ba-acb1-89eb01ccb684 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:40.177866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:40.186107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:40.191810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.191810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.191810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:40.191810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=209e9c8c1a0b41b58f51e94e4bd6c3ff) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:40.191810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:40.192175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 434/855] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:40.192175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a64bcc-b7e1-4c5d-8998-0c335c22b4b8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:40.192346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:40.209139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 422/856] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:40 2022] GET /identity/v3/role_assignments?user.id=209e9c8c1a0b41b58f51e94e4bd6c3ff&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:40.308682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a64bcc-b7e1-4c5d-8998-0c335c22b4b8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:40.348635 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:40.349604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.350038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.350462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:40.351255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:40.351713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:40.353283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:40.358867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 435/857] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:40.364817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:40.470331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:40.480170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9a90d-6b32-4e2e-9fa0-c81a8549de8a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:40.521110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:40.521734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.522280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.522560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:40.523704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:40.524037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:40.525941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:40.527716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:40.535566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 423/858] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:40.539086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:40.591952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff347f33-4ec8-4c5e-ac58-96d63510cbe7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:40.634015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3001d6e-ac30-4671-9db0-a42855c6fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:40.634927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001d6e-ac30-4671-9db0-a42855c6fed2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.635361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001d6e-ac30-4671-9db0-a42855c6fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.635814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3001d6e-ac30-4671-9db0-a42855c6fed2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:40.649121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3001d6e-ac30-4671-9db0-a42855c6fed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d3001d6e-ac30-4671-9db0-a42855c6fed2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:40.654931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:40.656120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 18:58:40.657112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:40.659434 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 436/859] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 18:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:40.668929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:40.783133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726aaff2-ae33-4d8f-9713-c8778513c0fb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:40.819161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a841f41-4ac2-4a8c-b22a-eedcc67673d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:40.820056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841f41-4ac2-4a8c-b22a-eedcc67673d7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.820752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841f41-4ac2-4a8c-b22a-eedcc67673d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.821233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841f41-4ac2-4a8c-b22a-eedcc67673d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:40.822049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a841f41-4ac2-4a8c-b22a-eedcc67673d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:40.822525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a841f41-4ac2-4a8c-b22a-eedcc67673d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:40.824054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a841f41-4ac2-4a8c-b22a-eedcc67673d7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:40.833884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 424/860] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 18:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:40.841116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3001d6e-ac30-4671-9db0-a42855c6fed2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:40.948695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3001d6e-ac30-4671-9db0-a42855c6fed2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:40.973126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:40.994471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:40.995386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:40.995851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:40.996279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:41.006489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7421072-edb9-4c29-b62a-48d75e39ebea None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:41.006779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7421072-edb9-4c29-b62a-48d75e39ebea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:41.007056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7421072-edb9-4c29-b62a-48d75e39ebea None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:41.008681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 425/861] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:41.010765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:41.012617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:41.013783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471606b8-0001-47ff-973c-60be1128e3d9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:41.014070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471606b8-0001-47ff-973c-60be1128e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:41.014348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471606b8-0001-47ff-973c-60be1128e3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:41.030677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:41.032404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:41.033639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:41.033639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:41.033639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:41.033862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-471606b8-0001-47ff-973c-60be1128e3d9 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:41.034199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-471606b8-0001-47ff-973c-60be1128e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:41.035640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 437/862] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:41.043935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:41.094252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:41.112047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 426/863] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:41.157236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e460bc-1468-45cd-b6a9-2340414e9461 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:41.192665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:41.193584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:41.194092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:41.194555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:41.195640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:41.196154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:41.197700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:41.216502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 438/864] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:41.224831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471606b8-0001-47ff-973c-60be1128e3d9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:41.330632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471606b8-0001-47ff-973c-60be1128e3d9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:41.367858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:41.368498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:41.368781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:41.369055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:41.376816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:41.378203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:41.384657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:41.390085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:41.391022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:41.392795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 427/865] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 18:58:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:41.399770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:41.416752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:41.459574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:41.508695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711046f-3133-47e4-a6a0-859b14320eee None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:41.525102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de4a35-96d3-46de-b964-b0875e6a3b6f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:41.545350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22755-cd6d-41cb-a564-9c3dec9cc023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:41.546258 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22755-cd6d-41cb-a564-9c3dec9cc023 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:41.546701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22755-cd6d-41cb-a564-9c3dec9cc023 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:41.547123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb22755-cd6d-41cb-a564-9c3dec9cc023 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:41.548098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb22755-cd6d-41cb-a564-9c3dec9cc023 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:41.549811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb22755-cd6d-41cb-a564-9c3dec9cc023 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:41.560023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:41.560631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:41.560913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:41.561188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:41.561924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:41.562232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:41.564426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:41.584076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 428/866] 10.222.0.82 () {56 vars in 1149 bytes} [Mon Aug 29 18:58:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:41.589128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:41.639960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 439/867] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:58:41 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:58:41.716614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc97dd-2152-4af5-9337-4f7c1e44f291 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:41.729648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:41.764977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce209-d303-4aa8-8956-781804a56eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:41.765991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce209-d303-4aa8-8956-781804a56eff None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:41.767716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce209-d303-4aa8-8956-781804a56eff None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:41.768373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce209-d303-4aa8-8956-781804a56eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:41.846133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ce209-d303-4aa8-8956-781804a56eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:41.847988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ce209-d303-4aa8-8956-781804a56eff None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:41.955867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 429/868] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:41 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 18:58:41.961935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22755-cd6d-41cb-a564-9c3dec9cc023 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:42.064759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:42.079889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb22755-cd6d-41cb-a564-9c3dec9cc023 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:42.118720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:42.119785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.120280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.120755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.133226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:42.135981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:42.151401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:42.152419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:42.153301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:42.153301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:42.153301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:42.155452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 440/869] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:42.162492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce209-d303-4aa8-8956-781804a56eff None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:42.167258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:42.274567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce209-d303-4aa8-8956-781804a56eff None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:42.310358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d967d-7425-48b2-bbe2-085eed60849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:42.310966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d967d-7425-48b2-bbe2-085eed60849c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.311247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d967d-7425-48b2-bbe2-085eed60849c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.311515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d967d-7425-48b2-bbe2-085eed60849c None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.312189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d967d-7425-48b2-bbe2-085eed60849c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:42.312488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d967d-7425-48b2-bbe2-085eed60849c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:42.314640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d967d-7425-48b2-bbe2-085eed60849c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:42.327108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 430/870] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:42.333629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:42.346639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e814-5691-4ccc-b7e0-762fe46923ea None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.347155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e814-5691-4ccc-b7e0-762fe46923ea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.347585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e814-5691-4ccc-b7e0-762fe46923ea None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.349386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 431/871] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:42.354607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f0fb-6699-40a1-a414-cca5fe5911e8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.355066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f0fb-6699-40a1-a414-cca5fe5911e8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.355497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9f0fb-6699-40a1-a414-cca5fe5911e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.375092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e0f9f0fb-6699-40a1-a414-cca5fe5911e8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:42.377247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e0f9f0fb-6699-40a1-a414-cca5fe5911e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:42.443574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:42.446891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1170fb-6e44-4d7d-a1ee-6cc891dc18ec None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:42.453625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 432/872] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:42.484202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7caa9-3b45-4633-8d04-473acd87636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:42.484893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7caa9-3b45-4633-8d04-473acd87636b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.486305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7caa9-3b45-4633-8d04-473acd87636b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.486642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7caa9-3b45-4633-8d04-473acd87636b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.493678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7caa9-3b45-4633-8d04-473acd87636b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:42.495274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7caa9-3b45-4633-8d04-473acd87636b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:42.497925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c9d7caa9-3b45-4633-8d04-473acd87636b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:42.509014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:42.510363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:42.512086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:42.512086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:42.512086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:42.512086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:42.512086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:42.512086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:42.512086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:42.512086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:42.517587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 441/873] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:42.523456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f0fb-6699-40a1-a414-cca5fe5911e8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:42.573919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2910a-3509-482c-8537-412b33f6dc8e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.574256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2910a-3509-482c-8537-412b33f6dc8e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.574592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2910a-3509-482c-8537-412b33f6dc8e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.576343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 442/874] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:42.582340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f86b-2c50-434c-9bf9-6169db670922 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.582898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f86b-2c50-434c-9bf9-6169db670922 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.583245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f86b-2c50-434c-9bf9-6169db670922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.603423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e7a8f86b-2c50-434c-9bf9-6169db670922 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:42.604739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e7a8f86b-2c50-434c-9bf9-6169db670922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:42.640829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9f0fb-6699-40a1-a414-cca5fe5911e8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:42.680066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:42.680967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.681411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.681881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.682736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:42.683204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:42.684355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 443/875] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:42.685031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:42.698473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 433/876] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:42.705948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8f86b-2c50-434c-9bf9-6169db670922 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:42.754608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:42.812968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8f86b-2c50-434c-9bf9-6169db670922 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:42.821925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:42.849584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:42.850966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.850966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.850966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.851441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=59e8a8c6ca7549238eeab1a5ad74f896) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:42.851767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:42.853197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:42.859775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 444/877] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:42 2022] GET /identity/v3/role_assignments?user.id=59e8a8c6ca7549238eeab1a5ad74f896&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:42.860071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:42.882223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec981614-9c32-4dd9-937d-2ce20a788fca None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:42.926880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:42.927449 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:42.927749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:42.928026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:42.928627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:42.930019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:42.941301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:42.942412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:42.943866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 434/878] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:42.948910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:42.975269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:43.081643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcf0fd-0518-47a8-a142-e21fd0993513 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:43.106138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98645c36-807b-4227-8ede-5f73e5e3c6cb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:43.128566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:43.129199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:43.129654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:43.129941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:43.130934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:43.131124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:43.131254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:43.132650 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:43.138451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 445/879] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:43.150019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:43.152066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e5da2-e3eb-46ae-8a99-28c1ebd9b44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:43.152914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e5da2-e3eb-46ae-8a99-28c1ebd9b44d None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:43.153207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e5da2-e3eb-46ae-8a99-28c1ebd9b44d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:43.153485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e5da2-e3eb-46ae-8a99-28c1ebd9b44d None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:43.155009 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e5da2-e3eb-46ae-8a99-28c1ebd9b44d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:43.156404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906e5da2-e3eb-46ae-8a99-28c1ebd9b44d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:43.223362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:43.246514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 435/880] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:58:42 2022] POST /identity/v3/services => generated 269 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:58:43.269875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9b828-38f0-45a7-b6b3-80d087636c7d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:43.315595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd87f42-0e88-4aae-97be-ed883b6e6339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:43.316256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87f42-0e88-4aae-97be-ed883b6e6339 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:43.316540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87f42-0e88-4aae-97be-ed883b6e6339 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:43.316819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd87f42-0e88-4aae-97be-ed883b6e6339 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:43.317468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd87f42-0e88-4aae-97be-ed883b6e6339 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:43.317777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd87f42-0e88-4aae-97be-ed883b6e6339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:43.319238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd87f42-0e88-4aae-97be-ed883b6e6339 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:43.325400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 446/881] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:43.792069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186207c-ca16-4fee-b594-b34c2c5e7c70 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:43.793117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186207c-ca16-4fee-b594-b34c2c5e7c70 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:43.793614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186207c-ca16-4fee-b594-b34c2c5e7c70 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:43.795428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 436/882] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:43.800700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe012-b7f3-4c37-a19e-a6a4be64cdef None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:43.801005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe012-b7f3-4c37-a19e-a6a4be64cdef None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:43.801362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe012-b7f3-4c37-a19e-a6a4be64cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:43.821544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6defe012-b7f3-4c37-a19e-a6a4be64cdef None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:43.822774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6defe012-b7f3-4c37-a19e-a6a4be64cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:43.893786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 447/883] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:44.168471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186207c-ca16-4fee-b594-b34c2c5e7c70 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:44.279757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186207c-ca16-4fee-b594-b34c2c5e7c70 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:44.313591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:44.314232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:44.314516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:44.314849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:44.315449 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:44.316844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:44.326287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:44.327265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:44.328555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 437/884] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:44.335886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe012-b7f3-4c37-a19e-a6a4be64cdef None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:44.390080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:44.449369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe012-b7f3-4c37-a19e-a6a4be64cdef None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:44.488043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:44.488670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:44.488954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:44.489323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:44.489971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:44.490281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:44.491828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:44.497376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 448/885] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:44.504226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:44.560084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:44.617310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7516018-f18a-4ea7-aa88-f31968d343a4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:44.653921 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:44.654537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:44.654823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:44.655101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:44.655751 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:44.656057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:44.658131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:44.663444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 438/886] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:44.669268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:44.773958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd28265-5853-4a61-b922-1b7e22a3245b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:44.788600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:44.810867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435c107-604b-46ed-8791-1849cd80fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:44.811485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435c107-604b-46ed-8791-1849cd80fce8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:44.811986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435c107-604b-46ed-8791-1849cd80fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:44.812296 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435c107-604b-46ed-8791-1849cd80fce8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:44.813025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435c107-604b-46ed-8791-1849cd80fce8 None admin] RBAC: Adding query filter params (interface=public, service_id=00c30361b84a4474bcde17b34bd40fc4, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:44.813376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435c107-604b-46ed-8791-1849cd80fce8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:44.814722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435c107-604b-46ed-8791-1849cd80fce8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:44.820755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 449/887] 10.222.0.82 () {56 vars in 1251 bytes} [Mon Aug 29 18:58:44 2022] GET /identity/v3/endpoints?service_id=00c30361b84a4474bcde17b34bd40fc4&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:44.827616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:44.934002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0043e7-e657-4b43-ab79-15ef0c2136e9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:44.941951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:44.971147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1c23e-aa91-4277-8387-8af8bfc35b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:44.971788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c23e-aa91-4277-8387-8af8bfc35b3b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:44.972076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c23e-aa91-4277-8387-8af8bfc35b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:44.972354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1c23e-aa91-4277-8387-8af8bfc35b3b None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:44.972973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1c23e-aa91-4277-8387-8af8bfc35b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:44.974350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1c23e-aa91-4277-8387-8af8bfc35b3b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:44.980850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 439/888] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 18:58:44 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 18:58:45.029115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30919cb-d87f-4696-95c4-87a9d76564d3 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.029449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30919cb-d87f-4696-95c4-87a9d76564d3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.029795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30919cb-d87f-4696-95c4-87a9d76564d3 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.032119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 450/889] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:45.039009 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0b28a-d391-4708-94a5-648c94064193 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.039343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0b28a-d391-4708-94a5-648c94064193 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.039563 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0b28a-d391-4708-94a5-648c94064193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.059111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-65e0b28a-d391-4708-94a5-648c94064193 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:45.060353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-65e0b28a-d391-4708-94a5-648c94064193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:45.136700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 440/890] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:45.379525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f220c-8067-4945-a95e-d4a69ef243b9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.380040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f220c-8067-4945-a95e-d4a69ef243b9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.380040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f220c-8067-4945-a95e-d4a69ef243b9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.381686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 451/891] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:45.386930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518efd-de52-4fdc-a59f-3c9fb905dc97 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.387227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518efd-de52-4fdc-a59f-3c9fb905dc97 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.387507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f518efd-de52-4fdc-a59f-3c9fb905dc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.405954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9f518efd-de52-4fdc-a59f-3c9fb905dc97 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:45.407206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f518efd-de52-4fdc-a59f-3c9fb905dc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:45.414728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f220c-8067-4945-a95e-d4a69ef243b9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:45.477693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 441/892] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:45.479360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce25752-458c-4440-961e-9c3a076ecb05 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.479644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce25752-458c-4440-961e-9c3a076ecb05 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.479948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce25752-458c-4440-961e-9c3a076ecb05 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.481353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 442/893] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:45.487861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52d76f-2163-4f2c-bb1c-9f1f40f03eaa None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.488140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52d76f-2163-4f2c-bb1c-9f1f40f03eaa None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.488419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52d76f-2163-4f2c-bb1c-9f1f40f03eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.507573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6a52d76f-2163-4f2c-bb1c-9f1f40f03eaa None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:45.508455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6a52d76f-2163-4f2c-bb1c-9f1f40f03eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:45.542287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f220c-8067-4945-a95e-d4a69ef243b9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:45.544106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:45.579494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588b59-95cb-42d8-927d-cb7b571ea7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:45.580173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588b59-95cb-42d8-927d-cb7b571ea7fa None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.580511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588b59-95cb-42d8-927d-cb7b571ea7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.580878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b588b59-95cb-42d8-927d-cb7b571ea7fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.592140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b588b59-95cb-42d8-927d-cb7b571ea7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:45.596419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 443/894] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1b588b59-95cb-42d8-927d-cb7b571ea7fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:45.602124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:45.603065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:58:45.604075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:45.611758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 452/895] 10.222.0.82 () {56 vars in 1120 bytes} [Mon Aug 29 18:58:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:45.613383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52d76f-2163-4f2c-bb1c-9f1f40f03eaa None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:45.718509 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52d76f-2163-4f2c-bb1c-9f1f40f03eaa None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:45.754119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:45.755054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.755565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.756195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.757280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:45.757873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:45.759852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:45.763451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588b59-95cb-42d8-927d-cb7b571ea7fa None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:45.776224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 444/896] 10.222.0.82 () {56 vars in 1115 bytes} [Mon Aug 29 18:58:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:45.778888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:45.813249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:45.816088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:45.879492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b588b59-95cb-42d8-927d-cb7b571ea7fa None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:45.907753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edfd4f-05b6-4660-accd-333784ec8586 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:45.916575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:45.917358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.917644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.917918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.918629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:45.920021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:45.930124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:45.931082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:45.932536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 453/897] 10.222.0.82 () {56 vars in 1132 bytes} [Mon Aug 29 18:58:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:45.933353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:45.949557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:45.950221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:45.950513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:45.950792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:45.961288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:45.962722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:45.979017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:45.980029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:45.980934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:45.980934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:45.980934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:45.980934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 445/898] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:45.981405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:46.049721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:46.053170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9c224-19d7-41f6-8120-f87ea3f6cf29 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.068397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:46.091300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d45b6d-9e8e-4204-808c-5d3767578e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.092124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d45b6d-9e8e-4204-808c-5d3767578e89 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.092338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d45b6d-9e8e-4204-808c-5d3767578e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.092614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d45b6d-9e8e-4204-808c-5d3767578e89 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.093263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d45b6d-9e8e-4204-808c-5d3767578e89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.095323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d45b6d-9e8e-4204-808c-5d3767578e89 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:46.095909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b08f69-0dd5-44c0-b919-e94366352a3d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.131356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.132079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.132363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.132638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.133295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:46.133602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.134974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:46.140645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 446/899] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:46.142173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:46.149769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 454/900] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:58:45 2022] POST /identity/v3/services => generated 241 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:46.150600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d45b6d-9e8e-4204-808c-5d3767578e89 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:46.271607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dc6b-d2fa-4ad9-9ff9-183e8be539e6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.294377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d45b6d-9e8e-4204-808c-5d3767578e89 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.310836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.311872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.312362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.312860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.314043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:46.314372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.316271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:46.324515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:46.330414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 447/901] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:46.338420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.338420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.338629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:46.338705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.338705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.338705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:46.338705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.338705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:46.344357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 455/902] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:46.351649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:46.378714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:46.465309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8958fc-245a-4797-a096-bf235449a721 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.473570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67336631-7e7e-4c28-8911-996d7d0d2754 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.505545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.506291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.506641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.506992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.507807 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] RBAC: Adding query filter params (interface=public, service_id=2fd3c6f52d27404c958fc494078bca29, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:46.508208 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.509654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:46.515614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 456/903] 10.222.0.82 () {56 vars in 1251 bytes} [Mon Aug 29 18:58:46 2022] GET /identity/v3/endpoints?service_id=2fd3c6f52d27404c958fc494078bca29&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:46.522957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:46.525608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.526263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.526548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.526822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.538611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.540102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:46.553137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:46.554182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:46.555111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 448/904] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 18:58:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:46.560486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:46.627358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:46.633962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:46.651408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082539a-252e-4300-ab33-abe136bb164d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.671875 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f77b40-e659-43e5-ae7a-8ce52cbf1527 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.692561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedcb55-a853-462e-92e1-c1fd8a0a3e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.693646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcb55-a853-462e-92e1-c1fd8a0a3e95 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.694151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcb55-a853-462e-92e1-c1fd8a0a3e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.694633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbedcb55-a853-462e-92e1-c1fd8a0a3e95 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.695753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedcb55-a853-462e-92e1-c1fd8a0a3e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.697773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbedcb55-a853-462e-92e1-c1fd8a0a3e95 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:46.712100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 457/905] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 18:58:46 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 18:58:46.716140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f006f5-818c-4f6a-b11c-007be76f49f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.716778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f006f5-818c-4f6a-b11c-007be76f49f7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.717120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f006f5-818c-4f6a-b11c-007be76f49f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.717403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f006f5-818c-4f6a-b11c-007be76f49f7 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.718160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f006f5-818c-4f6a-b11c-007be76f49f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:46.718472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f006f5-818c-4f6a-b11c-007be76f49f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.720717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f006f5-818c-4f6a-b11c-007be76f49f7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:46.742207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 449/906] 10.222.0.82 () {56 vars in 1149 bytes} [Mon Aug 29 18:58:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:46.748135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedcb55-a853-462e-92e1-c1fd8a0a3e95 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:46.864594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbedcb55-a853-462e-92e1-c1fd8a0a3e95 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:46.909859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07296e6f-9d23-49d0-88f8-73e2b7900807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:46.910475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07296e6f-9d23-49d0-88f8-73e2b7900807 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.910749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07296e6f-9d23-49d0-88f8-73e2b7900807 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.911024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07296e6f-9d23-49d0-88f8-73e2b7900807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:46.931348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:46.998623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07296e6f-9d23-49d0-88f8-73e2b7900807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:46.999109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8a18-d9ad-42c6-a699-79c1d69cbf30 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:46.999550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8a18-d9ad-42c6-a699-79c1d69cbf30 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:46.999757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ac8a18-d9ad-42c6-a699-79c1d69cbf30 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.002573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07296e6f-9d23-49d0-88f8-73e2b7900807 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:47.007206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 450/907] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:47.008141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829e2c-3f8b-4c00-a5b2-eb947c43fb2b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:47.008441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829e2c-3f8b-4c00-a5b2-eb947c43fb2b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:47.008719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61829e2c-3f8b-4c00-a5b2-eb947c43fb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.027290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-61829e2c-3f8b-4c00-a5b2-eb947c43fb2b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:47.028535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-61829e2c-3f8b-4c00-a5b2-eb947c43fb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:47.103832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 451/908] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:47.134536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 458/909] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:46 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:58:47.140508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61829e2c-3f8b-4c00-a5b2-eb947c43fb2b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.191784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:47.252960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61829e2c-3f8b-4c00-a5b2-eb947c43fb2b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:47.292063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:47.292709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:47.292988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:47.293257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.304895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:47.306335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:47.321991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:47.322949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:47.324271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:47.324271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:47.324271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:47.324271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 452/910] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:47.329975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07296e6f-9d23-49d0-88f8-73e2b7900807 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.383567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.409560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:47.477184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07296e6f-9d23-49d0-88f8-73e2b7900807 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:47.501814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:47.507250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcab6e7-dd6e-4305-8f63-a6a3e7dcf7e2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:47.518475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:47.519505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:47.520152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:47.520639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.521492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:47.521996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:47.523556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:47.542394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 459/911] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:47.544088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.548361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:47.549618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:47.549909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:47.550188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.550780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:47.552234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:47.564699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:47.565780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:47.571858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 453/912] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:47.576322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.678443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d5535-f4d7-4507-a105-50e2ab477436 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:47.695213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:47.715211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab09e1-5be2-4e39-8986-0d8d1f3f7a2f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:47.724505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:47.725150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:47.725430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:47.726114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.736761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:47.738462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:47.754153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:47.755136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:47.756048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:47.756048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:47.756048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:47.756048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:47.756048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:47.756048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:47.756048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:47.756048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:47.760302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 460/913] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:47.761352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.762802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:47.763854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:47.764568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:47.765057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.766003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:47.767014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:47.768933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:47.779341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 454/914] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:47.780970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.811787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:47.888622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d026fdc-f65e-4fee-bf9a-b1d92010cde2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:47.893414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5bd87-fb53-423a-bd07-5286f9abcd9f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:47.927206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:47.927867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:47.928153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:47.928586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.929341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:47.929657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:47.931131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:47.939175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:47.939845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:47.940985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:47.941277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:47.941957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:47.942263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:47.944694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:47.946275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 461/915] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:47.951362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 455/916] 10.222.0.82 () {56 vars in 1114 bytes} [Mon Aug 29 18:58:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:47.957270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.957426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:47.990130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:48.080379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:48.094803 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ab325-c5c9-4eb1-827a-a431b8280ee3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:48.119370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007213f7-2767-4e2d-94a2-a71a30dada41 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:48.135202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bf9c5-4382-4c7c-8ebe-5a78c96bb8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:48.136208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf9c5-4382-4c7c-8ebe-5a78c96bb8b1 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:48.136683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf9c5-4382-4c7c-8ebe-5a78c96bb8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:48.137283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf9c5-4382-4c7c-8ebe-5a78c96bb8b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:48.138157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bf9c5-4382-4c7c-8ebe-5a78c96bb8b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:48.139818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bf9c5-4382-4c7c-8ebe-5a78c96bb8b1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:48.161561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83cd7e-39ad-4895-9484-b45d7267b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:48.162746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83cd7e-39ad-4895-9484-b45d7267b98f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:48.162746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83cd7e-39ad-4895-9484-b45d7267b98f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:48.162959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83cd7e-39ad-4895-9484-b45d7267b98f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:48.163608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83cd7e-39ad-4895-9484-b45d7267b98f None admin] RBAC: Adding query filter params (role.id=6aaccad962de418390a21c0bd48f81ec, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=59e8a8c6ca7549238eeab1a5ad74f896) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:48.163955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83cd7e-39ad-4895-9484-b45d7267b98f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:48.165407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83cd7e-39ad-4895-9484-b45d7267b98f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:48.179849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 462/917] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:47 2022] GET /identity/v3/role_assignments?user.id=59e8a8c6ca7549238eeab1a5ad74f896&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=6aaccad962de418390a21c0bd48f81ec => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:48.218792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941d5a-f5c5-4a8e-bd23-104b210f52c2 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:48.219128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941d5a-f5c5-4a8e-bd23-104b210f52c2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:48.219392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0941d5a-f5c5-4a8e-bd23-104b210f52c2 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:48.221066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 463/918] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:48.226769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b97c0-c953-4555-afe5-790b37247ac5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:48.227093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b97c0-c953-4555-afe5-790b37247ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:48.227328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b97c0-c953-4555-afe5-790b37247ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:48.242726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 456/919] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 18:58:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:48.252555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-444b97c0-c953-4555-afe5-790b37247ac5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:48.253922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-444b97c0-c953-4555-afe5-790b37247ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:48.354630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 464/920] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:48.629224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bf9c5-4382-4c7c-8ebe-5a78c96bb8b1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:48.737946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bf9c5-4382-4c7c-8ebe-5a78c96bb8b1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:48.774860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167a0a5-6e06-47e5-9983-b647ca554684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:48.775933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167a0a5-6e06-47e5-9983-b647ca554684 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:48.776427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167a0a5-6e06-47e5-9983-b647ca554684 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:48.776912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167a0a5-6e06-47e5-9983-b647ca554684 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:48.777711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167a0a5-6e06-47e5-9983-b647ca554684 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:48.779281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167a0a5-6e06-47e5-9983-b647ca554684 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1167a0a5-6e06-47e5-9983-b647ca554684 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:48.789369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:48.790501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:48.791409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:48.794293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 457/921] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:48.800600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b97c0-c953-4555-afe5-790b37247ac5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:48.825074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:48.854304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659921-95ba-4984-8a52-f5aa9110fcc2 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:48.854600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659921-95ba-4984-8a52-f5aa9110fcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:48.854873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9659921-95ba-4984-8a52-f5aa9110fcc2 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:48.861284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 458/922] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:48.862845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb5bc-5176-4155-bbcf-5fc0d98ccc92 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:48.863302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb5bc-5176-4155-bbcf-5fc0d98ccc92 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:48.863585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bb5bc-5176-4155-bbcf-5fc0d98ccc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:48.883346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-953bb5bc-5176-4155-bbcf-5fc0d98ccc92 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:48.884503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-953bb5bc-5176-4155-bbcf-5fc0d98ccc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:48.888375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:48.925142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b97c0-c953-4555-afe5-790b37247ac5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:48.967883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 459/923] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:48.972052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:48.972661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:48.972941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:48.973217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:48.973851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:48.974156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:48.975528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:48.980633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 465/924] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:48.988795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bb5bc-5176-4155-bbcf-5fc0d98ccc92 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:49.100211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953bb5bc-5176-4155-bbcf-5fc0d98ccc92 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:49.134877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:49.135413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:49.135697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:49.136000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:49.136671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:49.136983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:49.138345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:49.144498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 460/925] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:49.150322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:49.240335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:49.260160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:49.264181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:49.266757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c39e9-16bb-4201-8263-0f0c7e6de70c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:49.304784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:49.305399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:49.305684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:49.305962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:49.306684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] RBAC: Adding query filter params (interface=public, service_id=7df07f7f263c49dabc326182eb58fbdf, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:49.306995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:49.308675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:49.314770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 466/926] 10.222.0.82 () {56 vars in 1251 bytes} [Mon Aug 29 18:58:49 2022] GET /identity/v3/endpoints?service_id=7df07f7f263c49dabc326182eb58fbdf&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:49.322110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:49.375642 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9428d-5eb4-44cd-b36f-75f0c6f4bdc9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:49.421774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:49.421774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:49.421774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:49.421774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:49.422189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:49.423015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:49.434249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:49.435225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 18:58:49.436185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:49.439803 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 461/927] 10.222.0.82 () {56 vars in 1132 bytes} [Mon Aug 29 18:58:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:49.442048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:49.473075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21d839-7eaa-4cf1-ba0f-d74ebb18a62f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:49.519683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba47eb-d222-466f-b495-f8830336d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:49.520324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba47eb-d222-466f-b495-f8830336d7d4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:49.520743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba47eb-d222-466f-b495-f8830336d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:49.521035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba47eb-d222-466f-b495-f8830336d7d4 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:49.521752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba47eb-d222-466f-b495-f8830336d7d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:49.523790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba47eb-d222-466f-b495-f8830336d7d4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:49.532329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 467/928] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 18:58:49 2022] GET /identity/v3/services => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 18:58:49.533696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:49.579323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1a912-22be-4180-84b5-309b728c10ac None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:49.618622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:49.619253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:49.619537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:49.619854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:49.620497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:49.620803 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:49.622186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:49.629088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 462/929] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:49.637064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba47eb-d222-466f-b495-f8830336d7d4 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:49.653181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:49.764825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba47eb-d222-466f-b495-f8830336d7d4 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:49.804955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30fb2d-f42c-49ac-b419-24ac990ab35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:49.806414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30fb2d-f42c-49ac-b419-24ac990ab35b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:49.806958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30fb2d-f42c-49ac-b419-24ac990ab35b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:49.807486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30fb2d-f42c-49ac-b419-24ac990ab35b None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:49.808369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30fb2d-f42c-49ac-b419-24ac990ab35b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:49.808893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30fb2d-f42c-49ac-b419-24ac990ab35b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:49.810556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30fb2d-f42c-49ac-b419-24ac990ab35b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:49.817046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 468/930] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:49.824790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:49.930064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d46c4-370c-48d1-bb4f-5453738bdda0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:49.961070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:49.972493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a448293-7c8f-42b9-90ac-8f72d9cafbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:49.981840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448293-7c8f-42b9-90ac-8f72d9cafbaa None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:49.981840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448293-7c8f-42b9-90ac-8f72d9cafbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:49.981840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448293-7c8f-42b9-90ac-8f72d9cafbaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:49.981840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448293-7c8f-42b9-90ac-8f72d9cafbaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:49.981840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448293-7c8f-42b9-90ac-8f72d9cafbaa None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:50.113444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 463/931] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 18:58:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:50.289426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae937-629c-4e57-98dd-7534d8b4cc40 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:50.289773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae937-629c-4e57-98dd-7534d8b4cc40 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:50.289984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ae937-629c-4e57-98dd-7534d8b4cc40 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:50.291590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 469/932] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:50.296958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecba47-7ef4-4dbf-a37e-731015e94edc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:50.297259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecba47-7ef4-4dbf-a37e-731015e94edc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:50.297757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecba47-7ef4-4dbf-a37e-731015e94edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:50.318646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-50ecba47-7ef4-4dbf-a37e-731015e94edc None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:50.319880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-50ecba47-7ef4-4dbf-a37e-731015e94edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:50.350981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460f4e6-82c2-419c-bcf8-f9e22581dd6f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:50.351302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460f4e6-82c2-419c-bcf8-f9e22581dd6f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:50.351540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460f4e6-82c2-419c-bcf8-f9e22581dd6f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:50.353163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 470/933] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:50.358121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280f0d-7d39-437c-b9d7-fe5fbab959b2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:50.358412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280f0d-7d39-437c-b9d7-fe5fbab959b2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:50.358686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8280f0d-7d39-437c-b9d7-fe5fbab959b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:50.377408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b8280f0d-7d39-437c-b9d7-fe5fbab959b2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:50.378511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b8280f0d-7d39-437c-b9d7-fe5fbab959b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:50.400943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 464/934] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:50.460026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 471/935] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:50.695198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecba47-7ef4-4dbf-a37e-731015e94edc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:50.757851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8280f0d-7d39-437c-b9d7-fe5fbab959b2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:50.760923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:50.815481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecba47-7ef4-4dbf-a37e-731015e94edc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:50.832242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:50.855018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:50.855718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:50.856024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:50.856296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:50.856937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:50.858487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:50.861873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING keystone.server.flask.common [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 18:58:50.887828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8280f0d-7d39-437c-b9d7-fe5fbab959b2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:50.920926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.sql.core [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 18:58:50.920926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 18:58:50.920926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [parameters: {'id': '4c01a126e001498e92580222dd2e5ff1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 18:58:50.920926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81882) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 18:58:50.928089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256599e-f6e0-44c8-8eab-0a53cfc86fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:50.929214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256599e-f6e0-44c8-8eab-0a53cfc86fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:50.929676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256599e-f6e0-44c8-8eab-0a53cfc86fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:50.930137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256599e-f6e0-44c8-8eab-0a53cfc86fb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:50.941420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256599e-f6e0-44c8-8eab-0a53cfc86fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c01a126e001498e92580222dd2e5ff1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c01a126e001498e92580222dd2e5ff1. Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application conn.query(q) Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 18:58:50.942468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application result.read() Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 18:58:50.943259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application next(self.gen) Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application yield resource Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application next(self.gen) Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise self.value Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application session.commit() Aug 29 18:58:50.944351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.session.flush() Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application compat.raise_( Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 18:58:50.945291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 18:58:50.946543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application conn.query(q) Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application result.read() Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 18:58:50.947363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [parameters: {'id': '4c01a126e001498e92580222dd2e5ff1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:50.949648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:50.951328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4c01a126e001498e92580222dd2e5ff1. Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 465/936] 10.222.0.82 () {60 vars in 1140 bytes} [Mon Aug 29 18:58:50 2022] POST /identity/v3/projects => generated 262 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:50.953253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b256599e-f6e0-44c8-8eab-0a53cfc86fb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:50.960761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:50.961699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:58:50.962543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:50.971258 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 472/937] 10.222.0.82 () {56 vars in 1120 bytes} [Mon Aug 29 18:58:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:50.973009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256599e-f6e0-44c8-8eab-0a53cfc86fb2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:51.057291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:51.076032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020caf3-55ca-44be-b60b-e049b7467d24 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:51.112166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256599e-f6e0-44c8-8eab-0a53cfc86fb2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:51.123210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:51.124800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.125236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.126977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.136839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:51.139229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:51.155505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:51.156390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.157368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:51.158206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:51.159261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:51.160395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 466/938] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:51.161576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.162466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:51.162918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:51.164466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:51.167486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:51.183190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 473/939] 10.222.0.82 () {56 vars in 1115 bytes} [Mon Aug 29 18:58:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:51.183770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:51.222097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:51.314325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83b89b-c65b-473a-9444-a23769dbfd4a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:51.314780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a86bec-1b4a-449f-b4b3-0667860eadf7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:51.342998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:51.353300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:51.359916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.359916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.359916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.360634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58115921-aba0-4b0b-8fff-de69ef9c09c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:51.361416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115921-aba0-4b0b-8fff-de69ef9c09c9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.361844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115921-aba0-4b0b-8fff-de69ef9c09c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.362271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115921-aba0-4b0b-8fff-de69ef9c09c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.363533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115921-aba0-4b0b-8fff-de69ef9c09c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:51.364017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115921-aba0-4b0b-8fff-de69ef9c09c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:51.366443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58115921-aba0-4b0b-8fff-de69ef9c09c9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:51.366838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:51.368495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:51.384213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:51.385439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:51.386569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:51.386569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:51.386569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:51.392862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 474/940] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:51.393932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:51.400512 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 467/941] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:51 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:51.533859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a3818-3014-40b6-adee-ba8be19ba098 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:51.573641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:51.574256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.574543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.574822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.575470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:51.575811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:51.577187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:51.583959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4053e3-58b9-40d9-acba-314484081fc8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.584243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4053e3-58b9-40d9-acba-314484081fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.584528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4053e3-58b9-40d9-acba-314484081fc8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.586645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 468/942] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:51.591403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 475/943] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:51.595980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e2c3-df81-4f46-ac73-27f2a363a9c0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.596400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e2c3-df81-4f46-ac73-27f2a363a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.596690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6e2c3-df81-4f46-ac73-27f2a363a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.597332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:51.618917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-46d6e2c3-df81-4f46-ac73-27f2a363a9c0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:51.620503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-46d6e2c3-df81-4f46-ac73-27f2a363a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:51.650010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:51.719834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 469/944] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:51.722149 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6904d5d-d6fe-4aae-a540-8128be5cc27b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:51.758524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:51.759221 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.759510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.759816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.767958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:51.769427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:51.782305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:51.783348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:51.785045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 476/945] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 18:58:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:51.789447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e2c3-df81-4f46-ac73-27f2a363a9c0 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:51.812505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:51.899863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6e2c3-df81-4f46-ac73-27f2a363a9c0 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:51.936432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:51.937053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:51.937340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:51.937619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:51.938401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:51.938709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:51.940178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:51.958647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 470/946] 10.222.0.82 () {56 vars in 1149 bytes} [Mon Aug 29 18:58:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:51.964271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.013597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.081320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d3283-c8f3-438c-9d41-c9088762a0a3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.096109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:52.115796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:52.125700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.127023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.127323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.127608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.140473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8c461-5984-4417-812c-637f52de5e69 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.147631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.149567 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:52.169018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:52.170052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:52.170959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:52.170959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:52.170959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:52.173719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 477/947] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:52.180022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.188276 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ae32e-f68c-4143-b23d-e902e4145142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.188977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae32e-f68c-4143-b23d-e902e4145142 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.189263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae32e-f68c-4143-b23d-e902e4145142 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.189540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ae32e-f68c-4143-b23d-e902e4145142 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.190138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae32e-f68c-4143-b23d-e902e4145142 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.191508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ae32e-f68c-4143-b23d-e902e4145142 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6e1ae32e-f68c-4143-b23d-e902e4145142 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:52.204371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:52.205658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:52.206513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:52.209080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 471/948] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:52.210475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701fa79-4b91-4a6e-bc17-3eb65143ef4f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.210769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701fa79-4b91-4a6e-bc17-3eb65143ef4f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.211047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701fa79-4b91-4a6e-bc17-3eb65143ef4f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.212456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 472/949] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:52.216705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701fa79-4b91-4a6e-bc17-3eb65143ef4f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.310085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b6f32-3bdc-4a87-9429-adc9d42406b2 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.332791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701fa79-4b91-4a6e-bc17-3eb65143ef4f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.350027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ef507-caf4-4502-8ec5-6f49dd57606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.350720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ef507-caf4-4502-8ec5-6f49dd57606c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.351011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ef507-caf4-4502-8ec5-6f49dd57606c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.351286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ef507-caf4-4502-8ec5-6f49dd57606c None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.351965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ef507-caf4-4502-8ec5-6f49dd57606c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:52.352275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ef507-caf4-4502-8ec5-6f49dd57606c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.353632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ef507-caf4-4502-8ec5-6f49dd57606c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.370362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 478/950] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:52.370362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a58f5-0765-4d71-b9fd-617799e01752 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.370362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a58f5-0765-4d71-b9fd-617799e01752 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.370362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a58f5-0765-4d71-b9fd-617799e01752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.373113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.373706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.373995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.374278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.374915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:52.375225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.376756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.386314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 473/951] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:52.386314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.387576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e26a58f5-0765-4d71-b9fd-617799e01752 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:52.388844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e26a58f5-0765-4d71-b9fd-617799e01752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:52.392756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:52.397708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:52.464703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 479/952] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:52.473008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a58f5-0765-4d71-b9fd-617799e01752 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.502404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f715dc5-dd05-4672-a30f-0850f89d0c68 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.539972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.541020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.541549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.542054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.550053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.551809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:52.565133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:52.566115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:52.567070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:52.567070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:52.567070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:52.567070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:52.567070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:52.567070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:52.567070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:52.567070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:52.569260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 474/953] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:52.575410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.587538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a58f5-0765-4d71-b9fd-617799e01752 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.628757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.629101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.629454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.629619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.630640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:52.631005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.633505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.643759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 480/954] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:52.650026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.659004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:52.665714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:52.713141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e3ce0-c129-4a52-a3e8-fc6a4a5d154e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.754692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.755302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.755588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.755896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.756588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:52.756900 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.758383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.770939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 475/955] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:52.771761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.792302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b3b49-79da-492e-92f8-e43905f1fbec None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.831601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a1035-1e48-4c1c-9bc6-4b7b84828dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.832242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a1035-1e48-4c1c-9bc6-4b7b84828dfc None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.832531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a1035-1e48-4c1c-9bc6-4b7b84828dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.832809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a1035-1e48-4c1c-9bc6-4b7b84828dfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.833487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a1035-1e48-4c1c-9bc6-4b7b84828dfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.834859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a1035-1e48-4c1c-9bc6-4b7b84828dfc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.890090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590aadf-0637-413a-a151-c5de5a9b05c4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:52.915616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 481/956] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 18:58:52 2022] POST /identity/v3/endpoints => generated 349 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:52.916745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a1035-1e48-4c1c-9bc6-4b7b84828dfc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:52.928601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:52.948979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:52.949618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:52.950613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:52.950891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:52.951496 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:52.953151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:52.963463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:52.964775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:52.965632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 476/957] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:52.971378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:53.013764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:53.070637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a1035-1e48-4c1c-9bc6-4b7b84828dfc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:53.117701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb02e97-8fcb-478b-9560-41fa365d0417 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:53.121992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6883d1a-8636-4c4f-82e1-dd1e72fb09f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:53.122669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6883d1a-8636-4c4f-82e1-dd1e72fb09f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:53.122950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6883d1a-8636-4c4f-82e1-dd1e72fb09f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:53.123226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6883d1a-8636-4c4f-82e1-dd1e72fb09f2 None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/59e8a8c6ca7549238eeab1a5ad74f896/roles/6aaccad962de418390a21c0bd48f81ec` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:53.133021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6883d1a-8636-4c4f-82e1-dd1e72fb09f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=59e8a8c6ca7549238eeab1a5ad74f896, role_id=6aaccad962de418390a21c0bd48f81ec)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:53.135763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6883d1a-8636-4c4f-82e1-dd1e72fb09f2 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:53.160474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:53.160995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:53.161285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:53.161562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:53.162197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:53.162501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:53.163882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:53.174182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 477/958] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:53.175248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:53.225041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 482/959] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:58:52 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/59e8a8c6ca7549238eeab1a5ad74f896/roles/6aaccad962de418390a21c0bd48f81ec => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:58:53.262401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:53.320317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94f51c-c315-4c21-a929-bfff552ba032 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:53.364607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8014c0-f11f-444e-b10e-39afc2d9cd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:53.365671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8014c0-f11f-444e-b10e-39afc2d9cd56 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:53.366192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8014c0-f11f-444e-b10e-39afc2d9cd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:53.366706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8014c0-f11f-444e-b10e-39afc2d9cd56 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:53.367788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8014c0-f11f-444e-b10e-39afc2d9cd56 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:53.368343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8014c0-f11f-444e-b10e-39afc2d9cd56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:53.370316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8014c0-f11f-444e-b10e-39afc2d9cd56 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:53.377242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 478/960] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:53.530295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab737f2-ddac-43a8-a3ec-45a5758f5a4e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:53.530666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab737f2-ddac-43a8-a3ec-45a5758f5a4e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:53.530844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab737f2-ddac-43a8-a3ec-45a5758f5a4e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:53.533294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 483/961] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:53.538740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026d2a-9b4c-4a6e-b478-ee467cd5eb77 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:53.539033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026d2a-9b4c-4a6e-b478-ee467cd5eb77 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:53.539310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026d2a-9b4c-4a6e-b478-ee467cd5eb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:53.559311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7e026d2a-9b4c-4a6e-b478-ee467cd5eb77 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:53.560514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7e026d2a-9b4c-4a6e-b478-ee467cd5eb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:53.639856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 479/962] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:53.915808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab737f2-ddac-43a8-a3ec-45a5758f5a4e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:54.026668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab737f2-ddac-43a8-a3ec-45a5758f5a4e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:54.048530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:54.063238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:54.063895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:54.064180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:54.064455 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:54.065116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:54.066615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:54.069321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING keystone.server.flask.common [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 18:58:54.110510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.sql.core [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 18:58:54.110510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 18:58:54.110510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [parameters: {'user_id': 'e1b2cffec4e54ce1aa195032e4fc6656', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 18:58:54.110510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81883) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application conn.query(q) Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result.read() Aug 29 18:58:54.117994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 18:58:54.118849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application next(self.gen) Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application yield resource Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application next(self.gen) Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise self.value Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application session.commit() Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 18:58:54.125593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.session.flush() Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application compat.raise_( Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 18:58:54.127745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 18:58:54.130001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application conn.query(q) Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application result.read() Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 18:58:54.132095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e1b2cffec4e54ce1aa195032e4fc6656', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:54.137511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 18:58:54.139372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 18:58:54.141752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 18:58:54.141752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 18:58:54.141752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 18:58:54.141752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 18:58:54.141752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 18:58:54.141752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:54.141752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 484/963] 10.222.0.82 () {60 vars in 1131 bytes} [Mon Aug 29 18:58:53 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:54.142731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026d2a-9b4c-4a6e-b478-ee467cd5eb77 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:54.191171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:54.250010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026d2a-9b4c-4a6e-b478-ee467cd5eb77 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:54.295773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21c34-e2a0-46ab-bdcd-6a688541d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:54.296430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21c34-e2a0-46ab-bdcd-6a688541d36d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:54.296716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21c34-e2a0-46ab-bdcd-6a688541d36d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:54.296996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21c34-e2a0-46ab-bdcd-6a688541d36d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:54.306165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab21c34-e2a0-46ab-bdcd-6a688541d36d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:54.307612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab21c34-e2a0-46ab-bdcd-6a688541d36d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5ab21c34-e2a0-46ab-bdcd-6a688541d36d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:54.320982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:54.321954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:54.323300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 480/964] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:58:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:54.330958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:54.443612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237eb36-22b8-4df8-9ba7-2012913a904f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:54.479640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bce158-24e7-4816-9d8a-73a18ab8210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:54.480282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce158-24e7-4816-9d8a-73a18ab8210a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:54.480562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce158-24e7-4816-9d8a-73a18ab8210a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:54.480839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce158-24e7-4816-9d8a-73a18ab8210a None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:54.481542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bce158-24e7-4816-9d8a-73a18ab8210a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:54.481847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bce158-24e7-4816-9d8a-73a18ab8210a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:54.483475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bce158-24e7-4816-9d8a-73a18ab8210a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:54.524998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 485/965] 10.222.0.82 () {56 vars in 1101 bytes} [Mon Aug 29 18:58:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:54.994691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a3ee-ebd5-404d-9a6d-e680530ca0aa None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:54.995067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a3ee-ebd5-404d-9a6d-e680530ca0aa None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:54.995351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8a3ee-ebd5-404d-9a6d-e680530ca0aa None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:54.996879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 481/966] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:55.002016 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57684fd-ff9c-4074-8e5e-e97244770613 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.002310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57684fd-ff9c-4074-8e5e-e97244770613 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.002592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57684fd-ff9c-4074-8e5e-e97244770613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.021241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f57684fd-ff9c-4074-8e5e-e97244770613 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:55.022744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f57684fd-ff9c-4074-8e5e-e97244770613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:55.059758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:55.093109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 486/967] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:55.240191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30244b6-95da-4e85-a7d3-100c86f3721f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.240705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30244b6-95da-4e85-a7d3-100c86f3721f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.240782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30244b6-95da-4e85-a7d3-100c86f3721f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.242229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 482/968] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:55.247405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20749f-97e8-47ef-88cc-7f7c3ea955d8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.247644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20749f-97e8-47ef-88cc-7f7c3ea955d8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.247953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20749f-97e8-47ef-88cc-7f7c3ea955d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.267990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0f20749f-97e8-47ef-88cc-7f7c3ea955d8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:55.269186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0f20749f-97e8-47ef-88cc-7f7c3ea955d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:55.340456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 487/969] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:55.367270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30244b6-95da-4e85-a7d3-100c86f3721f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:55.439332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bbc6b-e3f3-432c-8c8d-fb0c78f04540 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.439667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bbc6b-e3f3-432c-8c8d-fb0c78f04540 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.439940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bbc6b-e3f3-432c-8c8d-fb0c78f04540 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.441297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 488/970] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:58:55.446757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadfab8-eea2-455c-b2f9-70e2533acd42 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.447048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadfab8-eea2-455c-b2f9-70e2533acd42 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.447324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadfab8-eea2-455c-b2f9-70e2533acd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.466112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9cadfab8-eea2-455c-b2f9-70e2533acd42 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:55.467354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9cadfab8-eea2-455c-b2f9-70e2533acd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:55.474424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30244b6-95da-4e85-a7d3-100c86f3721f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:55.477150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:55.512734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:55.513719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.514157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.514581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.515483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:55.517194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:55.526785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:55.528010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:55.529076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:55.531493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 483/971] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:55.537807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:55.543388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 489/972] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:58:55.619233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadfab8-eea2-455c-b2f9-70e2533acd42 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:55.641221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7827-39d9-49f5-a8fe-acb89cb0ce81 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:55.651335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:55.680122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:55.680770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.681050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.681343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.681967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:55.682268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:55.683625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:55.688546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 484/973] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:55.694136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:55.732896 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadfab8-eea2-455c-b2f9-70e2533acd42 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:55.734702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:55.771036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd93de-562a-47a1-8b9c-247ba97fe861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:55.771590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd93de-562a-47a1-8b9c-247ba97fe861 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.771897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd93de-562a-47a1-8b9c-247ba97fe861 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.772169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd93de-562a-47a1-8b9c-247ba97fe861 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.783972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd93de-562a-47a1-8b9c-247ba97fe861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-75dd93de-562a-47a1-8b9c-247ba97fe861 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:58:55.788723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:55.789853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:55.790745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 490/974] 10.222.0.82 () {56 vars in 1120 bytes} [Mon Aug 29 18:58:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:55.795676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd93de-562a-47a1-8b9c-247ba97fe861 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:55.814620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe13ef-7173-4df7-bf5e-ae0e3fdb60e9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:55.849478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:55.850095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.850383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.850657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.851290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:55.851618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:55.852984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:55.857870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 485/975] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:55.858415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:55.888100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:55.898101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd93de-562a-47a1-8b9c-247ba97fe861 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:55.933918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451df1de-dccd-4403-8024-349b5009350c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:55.934527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df1de-dccd-4403-8024-349b5009350c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:55.934809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df1de-dccd-4403-8024-349b5009350c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:55.935084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451df1de-dccd-4403-8024-349b5009350c None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:55.935771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451df1de-dccd-4403-8024-349b5009350c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:55.936081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451df1de-dccd-4403-8024-349b5009350c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:55.937451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451df1de-dccd-4403-8024-349b5009350c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:55.946445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 491/976] 10.222.0.82 () {56 vars in 1115 bytes} [Mon Aug 29 18:58:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:55.947237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451df1de-dccd-4403-8024-349b5009350c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:55.962200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:55.968195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2c616-7234-447c-bf8f-2fb29801afff None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.003655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c731-6e17-4647-af28-3759991a5da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.004302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c731-6e17-4647-af28-3759991a5da8 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.004588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c731-6e17-4647-af28-3759991a5da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.004862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c731-6e17-4647-af28-3759991a5da8 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.005503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c731-6e17-4647-af28-3759991a5da8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.006866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c731-6e17-4647-af28-3759991a5da8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.046136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451df1de-dccd-4403-8024-349b5009350c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.075981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 486/977] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:58:55 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:58:56.079238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c731-6e17-4647-af28-3759991a5da8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:56.092983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.096143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.096939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.097347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.098171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] RBAC: Adding query filter params (interface=admin, service_id=7df07f7f263c49dabc326182eb58fbdf, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:56.098593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.100909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.112141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 492/978] 10.222.0.82 () {56 vars in 1249 bytes} [Mon Aug 29 18:58:55 2022] GET /identity/v3/endpoints?service_id=7df07f7f263c49dabc326182eb58fbdf&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:56.113417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:56.131220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:56.209991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c731-6e17-4647-af28-3759991a5da8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.237536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d920e-087e-4605-a0fc-2725eb973838 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.249839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.251412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.251852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.252233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.264163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.265609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.277695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b48ae-c8ee-4a10-a994-6610166de952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.278316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b48ae-c8ee-4a10-a994-6610166de952 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.278600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b48ae-c8ee-4a10-a994-6610166de952 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.278878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b48ae-c8ee-4a10-a994-6610166de952 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.279679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b48ae-c8ee-4a10-a994-6610166de952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:56.281131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:56.283249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:56.284825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:56.284825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:56.284825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:56.285228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b48ae-c8ee-4a10-a994-6610166de952 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.285373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 487/979] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:56.289230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:56.295960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 493/980] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 18:58:56 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 18:58:56.305398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:56.409888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c9e1-812a-4c46-ac22-7e2122b34240 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.449860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.451038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.451038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.451038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.451665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:56.452497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.453403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.466706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 488/981] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:56.475232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b48ae-c8ee-4a10-a994-6610166de952 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:56.555245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:56.581968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b48ae-c8ee-4a10-a994-6610166de952 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.632216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.632868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.633136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.633411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.641665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.643371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:58:56.654651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:56.655620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:56.662944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 494/982] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 18:58:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:56.666779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:56.739378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:56.774990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d3a97-a63b-4314-954c-ff7c1888e977 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.811865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.812485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.812764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.813646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.814389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:56.814696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:56.816134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:56.834492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 489/983] 10.222.0.82 () {56 vars in 1149 bytes} [Mon Aug 29 18:58:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:56.839924 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:56.941710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6858df2-df15-47f8-b94b-f9d1dc6e3b21 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:56.979054 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa902dc-fbf3-47ee-9dbc-47b4cbf03f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:56.979656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa902dc-fbf3-47ee-9dbc-47b4cbf03f48 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:56.979961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa902dc-fbf3-47ee-9dbc-47b4cbf03f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:56.980237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa902dc-fbf3-47ee-9dbc-47b4cbf03f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:56.983872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:57.052085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa902dc-fbf3-47ee-9dbc-47b4cbf03f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:57.053518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa902dc-fbf3-47ee-9dbc-47b4cbf03f48 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:57.160512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 495/984] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:58:56 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:58:57.165950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:57.275929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f9609-3720-40a6-ba08-078c5f5de56e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:57.303989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:57.313666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:57.319362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:57.319362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:57.319362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:57.325575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:57.327023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:58:57.344324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:57.345753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:58:57.346878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:58:57.346878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:58:57.346878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:57.347959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 490/985] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:57.353461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa902dc-fbf3-47ee-9dbc-47b4cbf03f48 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:57.390075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:57.459957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa902dc-fbf3-47ee-9dbc-47b4cbf03f48 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:57.496733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:57.497612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:57.498001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:57.498376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:57.499123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:57.499532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:57.501838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:57.518745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 496/986] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:57.520351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:57.622801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ca064-76dd-40da-b833-a336e234443b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:57.657321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:57.658065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:57.658448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:57.658824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:57.665769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:57.667407 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:58:57.680155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:57.681180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:58:57.682111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 491/987] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:57.688729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:57.788085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:57.794447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ec365-cb89-41ba-b21c-2e88ae7a9382 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:57.831580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921addfc-bc93-4ec0-8882-36c2ff028e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:57.832255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921addfc-bc93-4ec0-8882-36c2ff028e66 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:57.832547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921addfc-bc93-4ec0-8882-36c2ff028e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:57.832822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921addfc-bc93-4ec0-8882-36c2ff028e66 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:57.833520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921addfc-bc93-4ec0-8882-36c2ff028e66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:57.833830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921addfc-bc93-4ec0-8882-36c2ff028e66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:57.835306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921addfc-bc93-4ec0-8882-36c2ff028e66 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:57.847443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 497/988] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:57.853227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:57.895306 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:57.957946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488977-de07-4fbb-b6f8-7b460b83c191 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:57.992228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e603163-3c36-4df7-ada5-094e5065777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:57.992891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603163-3c36-4df7-ada5-094e5065777f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:57.993178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603163-3c36-4df7-ada5-094e5065777f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:57.993454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e603163-3c36-4df7-ada5-094e5065777f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:57.994181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603163-3c36-4df7-ada5-094e5065777f None admin] RBAC: Adding query filter params (role.id=6aaccad962de418390a21c0bd48f81ec, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=59e8a8c6ca7549238eeab1a5ad74f896) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:57.994497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603163-3c36-4df7-ada5-094e5065777f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:57.995934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e603163-3c36-4df7-ada5-094e5065777f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:58.002704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 492/989] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:58:57 2022] GET /identity/v3/role_assignments?user.id=59e8a8c6ca7549238eeab1a5ad74f896&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=6aaccad962de418390a21c0bd48f81ec => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:58.046088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d814aa3-dec7-4882-ab8f-0b070f1c9f6d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.046377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d814aa3-dec7-4882-ab8f-0b070f1c9f6d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.046570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d814aa3-dec7-4882-ab8f-0b070f1c9f6d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.049213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 498/990] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:58.054741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc33e8-df7a-4433-b7c2-f3c5503eeba0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.055075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc33e8-df7a-4433-b7c2-f3c5503eeba0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.055297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc33e8-df7a-4433-b7c2-f3c5503eeba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.075313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-26bc33e8-df7a-4433-b7c2-f3c5503eeba0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:58.076571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-26bc33e8-df7a-4433-b7c2-f3c5503eeba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:58.151278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 493/991] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:58.290588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a7f33-1b8c-4efb-9101-5f62aa8124fe None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.291133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a7f33-1b8c-4efb-9101-5f62aa8124fe None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.291133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a7f33-1b8c-4efb-9101-5f62aa8124fe None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.292634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 499/992] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:58:58.297816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c1e87-907e-4e75-a773-4588544aaf91 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.298206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c1e87-907e-4e75-a773-4588544aaf91 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.298421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c1e87-907e-4e75-a773-4588544aaf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.316556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-213c1e87-907e-4e75-a773-4588544aaf91 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:58:58.317739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-213c1e87-907e-4e75-a773-4588544aaf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:58:58.354880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:58.398100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 494/993] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:58:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:58:58.437125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a7f33-1b8c-4efb-9101-5f62aa8124fe None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.544361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a7f33-1b8c-4efb-9101-5f62aa8124fe None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:58.578823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:58.579447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.579648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.579952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.580634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:58.582019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:58.590863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:58.591867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:58:58.592746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:58.596044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 500/994] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:58:58.598334 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c1e87-907e-4e75-a773-4588544aaf91 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.674119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.697982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:58.701650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c1e87-907e-4e75-a773-4588544aaf91 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:58.745274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:58.745890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.746169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.746442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.747068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:58.747368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:58.748742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:58.754524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 495/995] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:58.759762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.789689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:58.790777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f1d5-0477-4593-824c-c300fe0639ea None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:58.827426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:58.828126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.829011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.829303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.829892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:58.831256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:58:58.840118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:58:58.841136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 18:58:58.841979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:58:58.844058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 501/996] 10.222.0.82 () {56 vars in 1126 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:58:58.848224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.870328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5bedf-bf62-4f98-8f96-c1976db0dcdd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:58.908592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:58.909210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.909495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.909770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.910405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:58.910713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:58.912158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:58.917398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 496/997] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:58.923382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:58.941022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:58.957342 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e7aef-a18e-4b9e-ae5e-a7f7f5acf92c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:58.995823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:58.996429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:58.996707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:58.997039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:58.997677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:58.997978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:58.999324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.007792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 502/998] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:59.011053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:59.026773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:59.037876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b014c-fde9-4ed3-8437-b1f7e458c35d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.075843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.076503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.076793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.077069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.077785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] RBAC: Adding query filter params (interface=public, service_id=cb408d129df748bb95a1fc728042d3bc, region_id=RegionOne) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:59.078126 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.080318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.088108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 497/999] 10.222.0.82 () {56 vars in 1251 bytes} [Mon Aug 29 18:58:58 2022] GET /identity/v3/endpoints?service_id=cb408d129df748bb95a1fc728042d3bc&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:58:59.093302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:59.123559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34813da-ec67-4ecb-9b96-d234c92b5405 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.163423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.164084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.164365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.164642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.165284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:58:59.165591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.166961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.172959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 503/1000] 10.222.0.82 () {56 vars in 1122 bytes} [Mon Aug 29 18:58:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:58:59.178836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:58:59.194627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:58:59.210983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb60fd-ee7f-4422-b1dd-3f67262552cc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.248384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f23ac1-eedb-4a74-814a-334b07db0aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.248996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f23ac1-eedb-4a74-814a-334b07db0aaa None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.249292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f23ac1-eedb-4a74-814a-334b07db0aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.249558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f23ac1-eedb-4a74-814a-334b07db0aaa None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.250203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f23ac1-eedb-4a74-814a-334b07db0aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.252217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f23ac1-eedb-4a74-814a-334b07db0aaa None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.258395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 498/1001] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 18:58:59 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 18:58:59.290617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b82f5-b7d7-4be9-8be7-c6bb90bcb6fc None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:58:59.331047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5239db-b1c6-46a0-be76-e85073f479b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:58:59.331563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5239db-b1c6-46a0-be76-e85073f479b8 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:58:59.331875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5239db-b1c6-46a0-be76-e85073f479b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:58:59.332146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5239db-b1c6-46a0-be76-e85073f479b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:58:59.332819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5239db-b1c6-46a0-be76-e85073f479b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:58:59.334179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5239db-b1c6-46a0-be76-e85073f479b8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:58:59.440694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 504/1002] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 18:58:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:00.041187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59843a-fc2b-46ee-b5f5-eea8a5aff97f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:00.042149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59843a-fc2b-46ee-b5f5-eea8a5aff97f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:00.042662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59843a-fc2b-46ee-b5f5-eea8a5aff97f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:00.044606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 499/1003] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:00.050377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca0f20-9f0c-4b1d-9344-b5d98057c8a5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:00.050673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca0f20-9f0c-4b1d-9344-b5d98057c8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:00.050954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca0f20-9f0c-4b1d-9344-b5d98057c8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:00.069750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b4ca0f20-9f0c-4b1d-9344-b5d98057c8a5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:00.071198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b4ca0f20-9f0c-4b1d-9344-b5d98057c8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:00.142201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:00.151892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 505/1004] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:00.440612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59843a-fc2b-46ee-b5f5-eea8a5aff97f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:00.461534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:00.549429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59843a-fc2b-46ee-b5f5-eea8a5aff97f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:00.585682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:00.586713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:00.587204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:00.587717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:00.588542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:00.590112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:00.599947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:00.601344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:00.602204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:00.607665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 500/1005] 10.222.0.82 () {56 vars in 1105 bytes} [Mon Aug 29 18:59:00 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:00.608813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca0f20-9f0c-4b1d-9344-b5d98057c8a5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:00.716677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca0f20-9f0c-4b1d-9344-b5d98057c8a5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:00.755159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f3bfc-b425-48d3-8121-6acf5722c03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:00.756209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3bfc-b425-48d3-8121-6acf5722c03b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:00.756723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3bfc-b425-48d3-8121-6acf5722c03b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:00.757204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f3bfc-b425-48d3-8121-6acf5722c03b None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:00.758041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f3bfc-b425-48d3-8121-6acf5722c03b None admin] RBAC: Adding query filter params (name=image) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:00.758583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f3bfc-b425-48d3-8121-6acf5722c03b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:00.760263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f3bfc-b425-48d3-8121-6acf5722c03b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:00.766178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 506/1006] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:00.772636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:00.859004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:00.878589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5fa3b-7dfc-43c6-943b-a4226ad7e9a2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:00.914191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc654b56-c6a3-477b-8e05-2c61f2c35657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:00.914809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654b56-c6a3-477b-8e05-2c61f2c35657 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:00.915093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654b56-c6a3-477b-8e05-2c61f2c35657 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:00.915368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654b56-c6a3-477b-8e05-2c61f2c35657 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:00.916033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654b56-c6a3-477b-8e05-2c61f2c35657 None admin] RBAC: Adding query filter params (type=image) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:00.916342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654b56-c6a3-477b-8e05-2c61f2c35657 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:00.917691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc654b56-c6a3-477b-8e05-2c61f2c35657 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:00.931853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 501/1007] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:01.203971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee5bf-1de6-4641-b415-1b6234de78c4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:01.203971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee5bf-1de6-4641-b415-1b6234de78c4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:01.204379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bee5bf-1de6-4641-b415-1b6234de78c4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:01.205715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 507/1008] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:01.211231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea15a-42bc-444c-97f5-e017208f01c7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:01.211649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea15a-42bc-444c-97f5-e017208f01c7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:01.211865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fea15a-42bc-444c-97f5-e017208f01c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:01.229782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-99fea15a-42bc-444c-97f5-e017208f01c7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:01.230953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-99fea15a-42bc-444c-97f5-e017208f01c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:01.299316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 502/1009] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:59:01.396713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917a1fd-9e3f-4442-a971-a296eb93fe55 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:01.397071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917a1fd-9e3f-4442-a971-a296eb93fe55 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:01.397264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917a1fd-9e3f-4442-a971-a296eb93fe55 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:01.398748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 508/1010] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:01.403742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26d07-b63e-46eb-a860-bff45d6543c7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:01.404050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26d07-b63e-46eb-a860-bff45d6543c7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:01.404329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c26d07-b63e-46eb-a860-bff45d6543c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:01.422922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a3c26d07-b63e-46eb-a860-bff45d6543c7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:01.424146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a3c26d07-b63e-46eb-a860-bff45d6543c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:01.525899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 503/1011] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:01 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:01.570789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917a1fd-9e3f-4442-a971-a296eb93fe55 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:01.633881 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:01.674740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917a1fd-9e3f-4442-a971-a296eb93fe55 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:01.708051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:01.708676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:01.708954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:01.709223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:01.709800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:01.711136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:01.720458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:01.721467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 18:59:01.722329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:01.724046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 509/1012] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:01.727358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c26d07-b63e-46eb-a860-bff45d6543c7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:01.736834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:01.803936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:01.835882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c26d07-b63e-46eb-a860-bff45d6543c7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:01.871501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:01.872144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:01.872428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:01.872699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:01.873328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:01.873631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:01.875004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:01.885380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 504/1013] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:59:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:01.886241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:01.913947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4f30d-2a82-49bf-9ee4-9a9b1c9099e7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:01.943085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:01.952836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21240-befa-43f2-a515-531ae436d1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:01.954130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21240-befa-43f2-a515-531ae436d1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:01.954412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21240-befa-43f2-a515-531ae436d1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:01.954833 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca21240-befa-43f2-a515-531ae436d1c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:01.956047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca21240-befa-43f2-a515-531ae436d1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:01.957501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca21240-befa-43f2-a515-531ae436d1c1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:01.959284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 510/1014] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:01.963140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:01.965408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21240-befa-43f2-a515-531ae436d1c1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:01.994794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674b0e-fe3b-415c-aa1d-182f810d1813 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:02.034706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:02.035322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.035608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.035929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.036570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] RBAC: Adding query filter params (type=compute) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:02.036932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:02.038298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:02.049230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 505/1015] 10.222.0.82 () {56 vars in 1112 bytes} [Mon Aug 29 18:59:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:02.050755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:02.084171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca21240-befa-43f2-a515-531ae436d1c1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:02.120731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e428f-1108-4c5f-b46a-4180294da41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:02.121357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e428f-1108-4c5f-b46a-4180294da41a None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.121613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e428f-1108-4c5f-b46a-4180294da41a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.121881 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e428f-1108-4c5f-b46a-4180294da41a None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.122520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e428f-1108-4c5f-b46a-4180294da41a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:02.123980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e428f-1108-4c5f-b46a-4180294da41a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:02.158286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c99041-0bfc-4296-b406-3efe3ddfa9ef None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:02.190715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe079b-bad4-4a92-bdab-803540aca912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:02.191318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe079b-bad4-4a92-bdab-803540aca912 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.191595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe079b-bad4-4a92-bdab-803540aca912 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.191892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe079b-bad4-4a92-bdab-803540aca912 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.192542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe079b-bad4-4a92-bdab-803540aca912 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:02.193891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe079b-bad4-4a92-bdab-803540aca912 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:02.198709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:02.203156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 511/1016] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:59:01 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:02.292345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 506/1017] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 18:59:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:59:02.890316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80d78-6a3a-4cbc-9db1-96b549473470 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.891347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80d78-6a3a-4cbc-9db1-96b549473470 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.891435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d80d78-6a3a-4cbc-9db1-96b549473470 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.892969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 512/1018] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:02.898019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d7bb-9b92-4634-8103-12971b36a9af None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:02.898317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d7bb-9b92-4634-8103-12971b36a9af None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:02.898600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0d7bb-9b92-4634-8103-12971b36a9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:02.917163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-46d0d7bb-9b92-4634-8103-12971b36a9af None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:02.918362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-46d0d7bb-9b92-4634-8103-12971b36a9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:02.994244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 507/1019] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:02 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:03.273011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d80d78-6a3a-4cbc-9db1-96b549473470 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:03.329424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:03.389623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d80d78-6a3a-4cbc-9db1-96b549473470 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:03.425456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37200c04-8871-4562-9369-519b623b1756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:03.426069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200c04-8871-4562-9369-519b623b1756 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:03.427444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200c04-8871-4562-9369-519b623b1756 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:03.427444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200c04-8871-4562-9369-519b623b1756 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:03.427444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37200c04-8871-4562-9369-519b623b1756 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:03.428651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37200c04-8871-4562-9369-519b623b1756 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:03.533452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 513/1020] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:59:03 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:04.229450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945bb51-bbc0-43da-b8cd-cbe23332bf6d None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.230008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945bb51-bbc0-43da-b8cd-cbe23332bf6d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.230008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945bb51-bbc0-43da-b8cd-cbe23332bf6d None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.231494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 508/1021] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:04.236830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0837b-16b7-45b0-849b-70cba4a42b81 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.237225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0837b-16b7-45b0-849b-70cba4a42b81 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.237386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0837b-16b7-45b0-849b-70cba4a42b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.255442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bea0837b-16b7-45b0-849b-70cba4a42b81 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:04.256662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bea0837b-16b7-45b0-849b-70cba4a42b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:04.328241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfef0b-4210-4282-ac65-e53126a0f24f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.329068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfef0b-4210-4282-ac65-e53126a0f24f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.329348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfef0b-4210-4282-ac65-e53126a0f24f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.330682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 509/1022] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:04.334633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 514/1023] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:04.335514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef1eda-9734-46da-838e-ad5e894ce323 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.335830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef1eda-9734-46da-838e-ad5e894ce323 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.336109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef1eda-9734-46da-838e-ad5e894ce323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.355565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-36ef1eda-9734-46da-838e-ad5e894ce323 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:04.356792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-36ef1eda-9734-46da-838e-ad5e894ce323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:04.429371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 510/1024] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:59:04.612460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0837b-16b7-45b0-849b-70cba4a42b81 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:04.643525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:04.699163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef1eda-9734-46da-838e-ad5e894ce323 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:04.718808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0837b-16b7-45b0-849b-70cba4a42b81 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:04.747501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:04.757351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00455568-a65a-4690-87e5-74dfdcaa35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:04.757994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00455568-a65a-4690-87e5-74dfdcaa35c6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.758267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00455568-a65a-4690-87e5-74dfdcaa35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.758545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00455568-a65a-4690-87e5-74dfdcaa35c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.761673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00455568-a65a-4690-87e5-74dfdcaa35c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:04.761673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00455568-a65a-4690-87e5-74dfdcaa35c6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:04.762830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 515/1025] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:04.768852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00455568-a65a-4690-87e5-74dfdcaa35c6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:04.807331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef1eda-9734-46da-838e-ad5e894ce323 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:04.846125 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badd5ca-c29c-4818-b78c-7e4918ccb1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:04.846767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd5ca-c29c-4818-b78c-7e4918ccb1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.847054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd5ca-c29c-4818-b78c-7e4918ccb1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.847762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badd5ca-c29c-4818-b78c-7e4918ccb1e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.857591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badd5ca-c29c-4818-b78c-7e4918ccb1e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-9badd5ca-c29c-4818-b78c-7e4918ccb1e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:04.862842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:04.864073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:04.865291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 511/1026] 10.222.0.82 () {56 vars in 1120 bytes} [Mon Aug 29 18:59:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:04.869625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badd5ca-c29c-4818-b78c-7e4918ccb1e8 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:04.884875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:04.888434 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00455568-a65a-4690-87e5-74dfdcaa35c6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:04.926430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c839c-4cf4-4360-8a16-11d75c69b570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:04.927039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c839c-4cf4-4360-8a16-11d75c69b570 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:04.927325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c839c-4cf4-4360-8a16-11d75c69b570 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:04.927605 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c839c-4cf4-4360-8a16-11d75c69b570 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:04.928304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c839c-4cf4-4360-8a16-11d75c69b570 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:04.929736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c839c-4cf4-4360-8a16-11d75c69b570 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:04.976208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badd5ca-c29c-4818-b78c-7e4918ccb1e8 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:04.983778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:05.013935 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.014540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.014821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.015093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.016313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:05.016769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.018132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:05.026590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 512/1027] 10.222.0.82 () {56 vars in 1115 bytes} [Mon Aug 29 18:59:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:05.032814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:05.068102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 516/1028] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:04 2022] POST /identity/v3/users => generated 285 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 18:59:05.150475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4543048-8981-492e-b59c-2c945a4b823c None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:05.190608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.191264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.191553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.191860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.208183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.209652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:05.227236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:05.228377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:59:05.229274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:05.229274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:05.229274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:05.229274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 513/1029] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:05.234427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c839c-4cf4-4360-8a16-11d75c69b570 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:05.346965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c839c-4cf4-4360-8a16-11d75c69b570 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:05.383806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75dd96-a8ac-44f4-9f93-cc129655b97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.384894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75dd96-a8ac-44f4-9f93-cc129655b97b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.385380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75dd96-a8ac-44f4-9f93-cc129655b97b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.385839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75dd96-a8ac-44f4-9f93-cc129655b97b None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.386676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75dd96-a8ac-44f4-9f93-cc129655b97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:05.387153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75dd96-a8ac-44f4-9f93-cc129655b97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.388731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75dd96-a8ac-44f4-9f93-cc129655b97b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:05.402957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 517/1030] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:05.409498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:05.433970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:05.514076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a3375-7822-49c0-9726-b251ed83051b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:05.546567 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aef2b-7467-4256-816c-d00d1710adc4 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.548251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aef2b-7467-4256-816c-d00d1710adc4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.548757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aef2b-7467-4256-816c-d00d1710adc4 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.549663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.550301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 518/1031] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:05.550413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.550570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.550849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.557003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e1cd7-17c1-42e9-82cb-e51cb4255707 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.557291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e1cd7-17c1-42e9-82cb-e51cb4255707 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.557569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e1cd7-17c1-42e9-82cb-e51cb4255707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.558932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.560540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:59:05.573064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:05.574047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:05.580185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 514/1032] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:59:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:05.580931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-301e1cd7-17c1-42e9-82cb-e51cb4255707 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:05.580931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-301e1cd7-17c1-42e9-82cb-e51cb4255707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:05.582714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:05.591112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:05.651781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 519/1033] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:05.676289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:05.696764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2184db-ac17-40b9-b9ef-04d9e53b89b2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:05.733491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.734093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.734371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.734690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.735530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:05.735858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.737259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:05.754723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 515/1034] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:59:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:05.760357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e1cd7-17c1-42e9-82cb-e51cb4255707 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:05.862954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e1cd7-17c1-42e9-82cb-e51cb4255707 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:05.897112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44960c9-08fc-4d8a-97e4-9a661598219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:05.897830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44960c9-08fc-4d8a-97e4-9a661598219e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:05.898211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44960c9-08fc-4d8a-97e4-9a661598219e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:05.898526 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44960c9-08fc-4d8a-97e4-9a661598219e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:05.914838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:05.925690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:05.970880 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44960c9-08fc-4d8a-97e4-9a661598219e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:05.972478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44960c9-08fc-4d8a-97e4-9a661598219e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.033735 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aa160-cec0-4844-915e-fd716bb9fa0a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.073788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.074436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.074717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.074988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.075577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.076949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:06.087466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:06.088517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:06.089376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:06.090517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 520/1035] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:06.092994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44960c9-08fc-4d8a-97e4-9a661598219e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.095371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 516/1036] 10.222.0.82 () {56 vars in 1105 bytes} [Mon Aug 29 18:59:05 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:06.096317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.099261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:06.151157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:06.209918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504796f-4ae7-4f24-927f-4523482cf2b2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.212767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44960c9-08fc-4d8a-97e4-9a661598219e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.247272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.247865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.248152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.248426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.249066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] RBAC: Adding query filter params (name=image) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:06.249371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.250730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.251376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.251549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.251872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.251964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.256799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 517/1037] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:06.262260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.268887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.270352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:06.288353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:06.289382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:59:06.290286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:06.290286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:06.290286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:06.290286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 521/1038] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:06.296345 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.335219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:06.373902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42502c-b8ba-412a-b832-d99e3940d520 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.411488 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:06.412062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.412882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.413392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.413896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.414575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] RBAC: Adding query filter params (type=image) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:06.414892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.416309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.417788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2bc60-1f21-45ac-bc00-ed68c7cc84d8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.421850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 518/1039] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:06.433402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.474283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.475293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.475907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.476365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.477584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:06.478127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.480717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.506038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 522/1040] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:06.507074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.545858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090564f-7a09-4be5-b0d5-34aec3d2a38a None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.575941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:06.583914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.584534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.584852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.585138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.585797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] RBAC: Adding query filter params (interface=public, service_id=40a87a02f2644ffe805e3f2c1f568a3f, region_id=RegionOne) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:06.586111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.587465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.593956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 519/1041] 10.222.0.82 () {56 vars in 1251 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/endpoints?service_id=40a87a02f2644ffe805e3f2c1f568a3f&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:06.600378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.616607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f85fc0-377c-42df-860c-85bb9ac6eda3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.652894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.653558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.653843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.654122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.661728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.663194 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:59:06.675202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:06.676158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:06.677067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 523/1042] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:06.682059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.702647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:06.712337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd441f3-fe0e-491e-a2c6-d7e8a7192744 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.749282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e2160-a440-4a1c-a68a-20f66718a3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.749886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e2160-a440-4a1c-a68a-20f66718a3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.750686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e2160-a440-4a1c-a68a-20f66718a3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.750992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e2160-a440-4a1c-a68a-20f66718a3b7 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.751678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e2160-a440-4a1c-a68a-20f66718a3b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.753048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e2160-a440-4a1c-a68a-20f66718a3b7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.767917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 520/1043] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 18:59:06.803983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2668c43-64b8-4024-9a97-a955269e3ba7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:06.848217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affe3a3-7d5d-4567-9df8-6466a749de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:06.848848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe3a3-7d5d-4567-9df8-6466a749de86 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:06.849133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe3a3-7d5d-4567-9df8-6466a749de86 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:06.849411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affe3a3-7d5d-4567-9df8-6466a749de86 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:06.850126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affe3a3-7d5d-4567-9df8-6466a749de86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:06.850438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affe3a3-7d5d-4567-9df8-6466a749de86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:06.851913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affe3a3-7d5d-4567-9df8-6466a749de86 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:06.864850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 524/1044] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:06.871170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e2160-a440-4a1c-a68a-20f66718a3b7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:06.935862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:06.981739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e2160-a440-4a1c-a68a-20f66718a3b7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:07.018117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb2dec-8bc0-4fb8-bf40-d2b0c1d56175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:07.018649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb2dec-8bc0-4fb8-bf40-d2b0c1d56175 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.018934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb2dec-8bc0-4fb8-bf40-d2b0c1d56175 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.019210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb2dec-8bc0-4fb8-bf40-d2b0c1d56175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.019983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb2dec-8bc0-4fb8-bf40-d2b0c1d56175 None admin] RBAC: Adding query filter params (role.id=6aaccad962de418390a21c0bd48f81ec, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=e02a03585caf46fdb09b4a2fdde91a51) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:07.020296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb2dec-8bc0-4fb8-bf40-d2b0c1d56175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:07.021713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb2dec-8bc0-4fb8-bf40-d2b0c1d56175 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:07.032017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 521/1045] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:06 2022] GET /identity/v3/role_assignments?user.id=e02a03585caf46fdb09b4a2fdde91a51&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=6aaccad962de418390a21c0bd48f81ec => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:07.174126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb637-6041-453c-8ee5-610577f0fdaf None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.174417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb637-6041-453c-8ee5-610577f0fdaf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.174697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb637-6041-453c-8ee5-610577f0fdaf None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.176335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 525/1046] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:07.181820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf7937-f449-4c74-8a59-b876d77b1dab None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.182145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf7937-f449-4c74-8a59-b876d77b1dab None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.182452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf7937-f449-4c74-8a59-b876d77b1dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.204395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8aaf7937-f449-4c74-8a59-b876d77b1dab None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:07.206007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8aaf7937-f449-4c74-8a59-b876d77b1dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:07.276176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 522/1047] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:07.545699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cb637-6041-453c-8ee5-610577f0fdaf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:07.628424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:07.650773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cb637-6041-453c-8ee5-610577f0fdaf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:07.686080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705fe2-a8f0-4413-bd71-a1e3474441da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:07.686707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705fe2-a8f0-4413-bd71-a1e3474441da None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.686987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705fe2-a8f0-4413-bd71-a1e3474441da None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.687258 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e705fe2-a8f0-4413-bd71-a1e3474441da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.697552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e705fe2-a8f0-4413-bd71-a1e3474441da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2e705fe2-a8f0-4413-bd71-a1e3474441da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:07.702508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:07.703596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:07.704884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:07.706002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 526/1048] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:07.709692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf7937-f449-4c74-8a59-b876d77b1dab None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:07.764695 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:07.814227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf7937-f449-4c74-8a59-b876d77b1dab None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:07.851160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:07.851802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:07.852085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:07.852364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:07.853030 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:07.853337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:07.854693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:07.867511 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 523/1049] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:07.868920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705fe2-a8f0-4413-bd71-a1e3474441da None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:07.977387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e705fe2-a8f0-4413-bd71-a1e3474441da None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.013017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59cbd-5bfc-444e-9224-c1ecd868efcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.013659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59cbd-5bfc-444e-9224-c1ecd868efcb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.013943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59cbd-5bfc-444e-9224-c1ecd868efcb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.014221 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c59cbd-5bfc-444e-9224-c1ecd868efcb None admin] PATH_INFO: `/v3/users/65a3cc3e061b425998a3a41cc5dfe2e4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.022466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:08.028882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c59cbd-5bfc-444e-9224-c1ecd868efcb None admin] RBAC: Authorizing `identity:get_user(user_id=65a3cc3e061b425998a3a41cc5dfe2e4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.030328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c59cbd-5bfc-444e-9224-c1ecd868efcb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.034277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 527/1050] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:07 2022] GET /identity/v3/users/65a3cc3e061b425998a3a41cc5dfe2e4 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:08.038160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:08.146118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba8129-c75f-4e68-8701-b1994119e759 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.161470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:08.181778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58546e-50b7-42ea-9341-0a2d4fd2c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.182394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58546e-50b7-42ea-9341-0a2d4fd2c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.182679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58546e-50b7-42ea-9341-0a2d4fd2c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.182956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58546e-50b7-42ea-9341-0a2d4fd2c0e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.256491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58546e-50b7-42ea-9341-0a2d4fd2c0e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.258192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58546e-50b7-42ea-9341-0a2d4fd2c0e2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.362956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 524/1051] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:08.364462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59cbd-5bfc-444e-9224-c1ecd868efcb None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:08.478916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c59cbd-5bfc-444e-9224-c1ecd868efcb None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.514765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cb214-df72-42d5-9bf7-833a426fac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.515403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb214-df72-42d5-9bf7-833a426fac9d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.515682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb214-df72-42d5-9bf7-833a426fac9d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.516705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cb214-df72-42d5-9bf7-833a426fac9d None admin] PATH_INFO: `/v3/projects/0242c2742f61415cb0d21e6d6bdb44de` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.518070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cb214-df72-42d5-9bf7-833a426fac9d None admin] RBAC: Authorizing `identity:get_project(project_id=0242c2742f61415cb0d21e6d6bdb44de)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.519504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cb214-df72-42d5-9bf7-833a426fac9d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.528569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 528/1052] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:08 2022] GET /identity/v3/projects/0242c2742f61415cb0d21e6d6bdb44de => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:08.528749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58546e-50b7-42ea-9341-0a2d4fd2c0e2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:08.543271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:08.630616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58546e-50b7-42ea-9341-0a2d4fd2c0e2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:08.665532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d54d1-4ebd-44fa-969d-e712dfe367b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:08.666142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d54d1-4ebd-44fa-969d-e712dfe367b7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.666425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d54d1-4ebd-44fa-969d-e712dfe367b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.666701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d54d1-4ebd-44fa-969d-e712dfe367b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.667424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d54d1-4ebd-44fa-969d-e712dfe367b7 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=0242c2742f61415cb0d21e6d6bdb44de, user.id=65a3cc3e061b425998a3a41cc5dfe2e4) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:08.667745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d54d1-4ebd-44fa-969d-e712dfe367b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:08.669177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d54d1-4ebd-44fa-969d-e712dfe367b7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:08.679812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 525/1053] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:08 2022] GET /identity/v3/role_assignments?user.id=65a3cc3e061b425998a3a41cc5dfe2e4&scope.project.id=0242c2742f61415cb0d21e6d6bdb44de&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:08.737622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a35c7-bb74-4c57-821f-88b0c3b2e217 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.738187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a35c7-bb74-4c57-821f-88b0c3b2e217 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.738187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a35c7-bb74-4c57-821f-88b0c3b2e217 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.739617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 529/1054] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:08.745259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e9909-37e4-4373-86d6-a2d39124ee20 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.745784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e9909-37e4-4373-86d6-a2d39124ee20 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.745865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e9909-37e4-4373-86d6-a2d39124ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.764985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-331e9909-37e4-4373-86d6-a2d39124ee20 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:08.766893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-331e9909-37e4-4373-86d6-a2d39124ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:08.855769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 526/1055] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:08.948410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90569b34-a5cd-44a1-a127-c636040be6cc None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.948735 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90569b34-a5cd-44a1-a127-c636040be6cc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.948965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90569b34-a5cd-44a1-a127-c636040be6cc None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.950436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 530/1056] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:08.956149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf005a-c9c5-4e56-8926-0afa9bc1b3a3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:08.956431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf005a-c9c5-4e56-8926-0afa9bc1b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:08.956708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf005a-c9c5-4e56-8926-0afa9bc1b3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:08.975185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-84bf005a-c9c5-4e56-8926-0afa9bc1b3a3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:08.976384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-84bf005a-c9c5-4e56-8926-0afa9bc1b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:08.978564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:09.043908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 527/1057] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:09.127686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90569b34-a5cd-44a1-a127-c636040be6cc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:09.196010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:09.241948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90569b34-a5cd-44a1-a127-c636040be6cc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:09.276950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:09.277579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:09.277861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:09.278133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:09.278710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:09.280094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:09.290099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:09.291105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:09.291987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 531/1058] 10.222.0.82 () {56 vars in 1105 bytes} [Mon Aug 29 18:59:09 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:09.298468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf005a-c9c5-4e56-8926-0afa9bc1b3a3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:09.315309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:09.403611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf005a-c9c5-4e56-8926-0afa9bc1b3a3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:09.426724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74815446-4481-41ea-a690-5ee707a062f6 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:09.440753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:09.441373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:09.441656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:09.441938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:09.442573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] RBAC: Adding query filter params (name=image) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:09.442882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:09.444315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:09.451772 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 528/1059] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:09.455975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:09.459416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:09.462942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:09.471124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4779-cadf-4ec2-b33f-702d171b7fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:09.475929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4779-cadf-4ec2-b33f-702d171b7fef None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:09.475929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4779-cadf-4ec2-b33f-702d171b7fef None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:09.475929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f4779-cadf-4ec2-b33f-702d171b7fef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:09.482147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f4779-cadf-4ec2-b33f-702d171b7fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-780f4779-cadf-4ec2-b33f-702d171b7fef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:09.487596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:09.488737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:09.489718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 532/1060] 10.222.0.82 () {56 vars in 1120 bytes} [Mon Aug 29 18:59:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:09.494994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4779-cadf-4ec2-b33f-702d171b7fef None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:09.567225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71928aa-aa18-43a3-93bc-dcbd26bdfa11 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:09.601384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f4779-cadf-4ec2-b33f-702d171b7fef None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:09.604548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:09.605388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:09.605848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:09.606300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:09.607121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] RBAC: Adding query filter params (type=image) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:09.607601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:09.610178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:09.615914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 529/1061] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:09.621435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:09.645727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:09.646631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:09.646917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:09.647192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:09.648072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:09.648715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:09.650484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:09.667187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 533/1062] 10.222.0.82 () {56 vars in 1115 bytes} [Mon Aug 29 18:59:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:09.668269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:09.694788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:09.721583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:09.733163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bead76-0ce5-4a22-9f69-58f81da7151b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:09.773022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ece1-9288-4a52-a524-f199716d4c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:09.773685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ece1-9288-4a52-a524-f199716d4c46 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:09.774146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ece1-9288-4a52-a524-f199716d4c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:09.774425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ece1-9288-4a52-a524-f199716d4c46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:09.775092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363ece1-9288-4a52-a524-f199716d4c46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:09.776466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363ece1-9288-4a52-a524-f199716d4c46 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:09.777669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1893c47-9b91-4221-b5ab-4c41a885f2e8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:09.812404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:09.813873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:09.813873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:09.814253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:09.833708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:09.833708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:09.842047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:09.843198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:59:09.844347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:09.844347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:09.844347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:09.844347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 534/1063] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:09.849005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:09.858658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 530/1064] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 18:59:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:09.976240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90284a-51e5-4a87-8c52-d131be46b0f8 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:09.979367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:10.025090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:10.025705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.025987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.026255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.026900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:10.027206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:10.028591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:10.040545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 535/1065] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:10.046356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ece1-9288-4a52-a524-f199716d4c46 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:10.160073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ece1-9288-4a52-a524-f199716d4c46 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:10.182760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:10.195441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:10.196581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.196913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.200289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.210319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:10.211849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:59:10.224544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:10.229415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:10.230374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 531/1066] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:59:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:10.232581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:10.336427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a8a3-8850-4045-9442-4bd536cb5cad None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:10.370994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:10.371654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.371966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.372292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.373071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:10.373383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:10.374831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:10.397784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 536/1067] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:59:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:10.399502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:10.505932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296d4a2-64ab-440b-b8df-86fae5191a91 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:10.539802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ddd56-cf2b-43a3-826f-812323ec133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:10.540392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ddd56-cf2b-43a3-826f-812323ec133f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.540699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ddd56-cf2b-43a3-826f-812323ec133f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.540978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ddd56-cf2b-43a3-826f-812323ec133f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.552362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ddd56-cf2b-43a3-826f-812323ec133f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:10.553793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ddd56-cf2b-43a3-826f-812323ec133f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6b8ddd56-cf2b-43a3-826f-812323ec133f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:10.567757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:10.568737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:59:10.574671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:10.574671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:10.574671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:10.574671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 532/1068] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:10.576139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:10.595740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:10.627950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc45b7-ae54-4c70-b17a-22815b075454 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.628239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc45b7-ae54-4c70-b17a-22815b075454 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.628521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc45b7-ae54-4c70-b17a-22815b075454 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.629902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 533/1069] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:10.634932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2c7b5-7b5a-4597-84de-a44211cfa59e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.635208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2c7b5-7b5a-4597-84de-a44211cfa59e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.635488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2c7b5-7b5a-4597-84de-a44211cfa59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.653928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b5c2c7b5-7b5a-4597-84de-a44211cfa59e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:10.655131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b5c2c7b5-7b5a-4597-84de-a44211cfa59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:10.685170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:10.688591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a7e65-e080-4a12-badc-0a5c6573198f None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:10.725510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:10.726129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.726414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.726826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 534/1070] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:59:10.727961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.728644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:10.728958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:10.730320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:10.743889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 537/1071] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:10.748000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2c7b5-7b5a-4597-84de-a44211cfa59e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:10.848228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2c7b5-7b5a-4597-84de-a44211cfa59e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:10.885992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:10.886855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:10.887307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:10.887898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:10.895993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:10.897419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:59:10.909479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:10.910424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:10.911323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:59:10.911323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:59:10.911323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:59:10.911323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:59:10.911323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:59:10.911323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:59:10.911323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:59:10.911323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:10.916984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 535/1072] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:10.917108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:10.997711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:11.007878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:11.025292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ece3-609f-40c6-8f86-3fdcda05e514 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.038463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:11.062535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.063195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.063469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.063761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.064473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:11.064780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:11.066204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:11.079840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 538/1073] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:59:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:11.085668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:11.120410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e8aae-2fd3-469e-a841-e582ba1c46c0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.175330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9edfaf-6952-4eb9-82fd-f678abac13a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.176083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9edfaf-6952-4eb9-82fd-f678abac13a2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.176364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9edfaf-6952-4eb9-82fd-f678abac13a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.176634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9edfaf-6952-4eb9-82fd-f678abac13a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.187530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9edfaf-6952-4eb9-82fd-f678abac13a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-5e9edfaf-6952-4eb9-82fd-f678abac13a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:11.192841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:11.193795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:11.194852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 536/1074] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:11.200292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9edfaf-6952-4eb9-82fd-f678abac13a2 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:11.214410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd365bcb-c487-4815-8651-ea9cd936bc5b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.255934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c55ba-199e-4402-9c1c-5463f5af8062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.256939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c55ba-199e-4402-9c1c-5463f5af8062 None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.257878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c55ba-199e-4402-9c1c-5463f5af8062 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.258304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c55ba-199e-4402-9c1c-5463f5af8062 None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/e02a03585caf46fdb09b4a2fdde91a51/roles/6aaccad962de418390a21c0bd48f81ec` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.262316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c55ba-199e-4402-9c1c-5463f5af8062 None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=e02a03585caf46fdb09b4a2fdde91a51, role_id=6aaccad962de418390a21c0bd48f81ec)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:11.265204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c55ba-199e-4402-9c1c-5463f5af8062 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:11.270385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:11.290820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:11.306228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9edfaf-6952-4eb9-82fd-f678abac13a2 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.340102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.340747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.341028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.341295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.341947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:11.342245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:11.343580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:11.352258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 537/1075] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:11.358040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:11.367945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 539/1076] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:11 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/e02a03585caf46fdb09b4a2fdde91a51/roles/6aaccad962de418390a21c0bd48f81ec => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 18:59:11.480631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c333b0d-3f57-4431-904a-b099fa46b84f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.524441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8d3a2-f4b0-495a-9211-704a0b5691a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.525224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8d3a2-f4b0-495a-9211-704a0b5691a6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.525508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8d3a2-f4b0-495a-9211-704a0b5691a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.525781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8d3a2-f4b0-495a-9211-704a0b5691a6 None admin] PATH_INFO: `/v3/users/65a3cc3e061b425998a3a41cc5dfe2e4` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.526925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8d3a2-f4b0-495a-9211-704a0b5691a6 None admin] RBAC: Authorizing `identity:get_user(user_id=65a3cc3e061b425998a3a41cc5dfe2e4)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:11.528382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8d3a2-f4b0-495a-9211-704a0b5691a6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:11.530294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 538/1077] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:11 2022] GET /identity/v3/users/65a3cc3e061b425998a3a41cc5dfe2e4 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:11.536923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c55ba-199e-4402-9c1c-5463f5af8062 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:11.640185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c55ba-199e-4402-9c1c-5463f5af8062 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.676300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f7aa0-2b7a-44c3-b98f-6db39a1e9ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.676960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f7aa0-2b7a-44c3-b98f-6db39a1e9ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.677256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f7aa0-2b7a-44c3-b98f-6db39a1e9ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.677579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f7aa0-2b7a-44c3-b98f-6db39a1e9ce8 None admin] PATH_INFO: `/v3/projects/0242c2742f61415cb0d21e6d6bdb44de` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.678716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f7aa0-2b7a-44c3-b98f-6db39a1e9ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=0242c2742f61415cb0d21e6d6bdb44de)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:11.680184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f7aa0-2b7a-44c3-b98f-6db39a1e9ce8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:11.682049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 540/1078] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:11 2022] GET /identity/v3/projects/0242c2742f61415cb0d21e6d6bdb44de => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:11.688037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8d3a2-f4b0-495a-9211-704a0b5691a6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:11.705775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:11.791241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8d3a2-f4b0-495a-9211-704a0b5691a6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:11.827972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f87a-3669-4f90-9976-c67390c3a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:11.829190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f87a-3669-4f90-9976-c67390c3a4a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.829468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f87a-3669-4f90-9976-c67390c3a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.829740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f87a-3669-4f90-9976-c67390c3a4a4 None admin] PATH_INFO: `/v3/projects/0242c2742f61415cb0d21e6d6bdb44de/users/65a3cc3e061b425998a3a41cc5dfe2e4/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.831597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1f87a-3669-4f90-9976-c67390c3a4a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0242c2742f61415cb0d21e6d6bdb44de, user_id=65a3cc3e061b425998a3a41cc5dfe2e4, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:11.833231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1f87a-3669-4f90-9976-c67390c3a4a4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:11.896872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaa74c-09c6-477d-adbf-6ab3b3d6a14c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.897196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaa74c-09c6-477d-adbf-6ab3b3d6a14c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.897609 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaa74c-09c6-477d-adbf-6ab3b3d6a14c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.898909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 541/1079] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:11.904047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb3b5-95af-415b-a9aa-1e643c1a43dc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:11.904420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb3b5-95af-415b-a9aa-1e643c1a43dc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:11.904526 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 539/1080] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:11 2022] PUT /identity/v3/projects/0242c2742f61415cb0d21e6d6bdb44de/users/65a3cc3e061b425998a3a41cc5dfe2e4/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 18:59:11.911062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb3b5-95af-415b-a9aa-1e643c1a43dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:11.928802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-426bb3b5-95af-415b-a9aa-1e643c1a43dc None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:11.930056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-426bb3b5-95af-415b-a9aa-1e643c1a43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:11.999087 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:12.009979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 542/1081] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:59:12.282718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f87a-3669-4f90-9976-c67390c3a4a4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:12.361031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:12.387158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f87a-3669-4f90-9976-c67390c3a4a4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:12.427215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41252ba0-124c-468f-878f-41e35d260817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:12.428326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41252ba0-124c-468f-878f-41e35d260817 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:12.428622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41252ba0-124c-468f-878f-41e35d260817 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:12.428876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41252ba0-124c-468f-878f-41e35d260817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:12.511198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41252ba0-124c-468f-878f-41e35d260817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:12.512671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41252ba0-124c-468f-878f-41e35d260817 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:12.589274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:12.615808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 540/1082] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:12.623223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bb3b5-95af-415b-a9aa-1e643c1a43dc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:12.722686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bb3b5-95af-415b-a9aa-1e643c1a43dc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:12.756885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7029e-2c87-4d89-ba70-6c5fe562e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:12.757522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7029e-2c87-4d89-ba70-6c5fe562e62b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:12.757808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7029e-2c87-4d89-ba70-6c5fe562e62b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:12.758088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7029e-2c87-4d89-ba70-6c5fe562e62b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:12.769352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7029e-2c87-4d89-ba70-6c5fe562e62b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:12.770747 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7029e-2c87-4d89-ba70-6c5fe562e62b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fff7029e-2c87-4d89-ba70-6c5fe562e62b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:12.786240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:12.787196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:59:12.789821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:12.789821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:12.789821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:12.790364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 543/1083] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:12.793746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41252ba0-124c-468f-878f-41e35d260817 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:12.900558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41252ba0-124c-468f-878f-41e35d260817 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:12.937227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd32a8-d804-4b8a-9f43-351c6c39aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:12.938404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd32a8-d804-4b8a-9f43-351c6c39aabc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:12.938652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd32a8-d804-4b8a-9f43-351c6c39aabc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:12.938923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd32a8-d804-4b8a-9f43-351c6c39aabc None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:12.939566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd32a8-d804-4b8a-9f43-351c6c39aabc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:12.939896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd32a8-d804-4b8a-9f43-351c6c39aabc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:12.941250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd32a8-d804-4b8a-9f43-351c6c39aabc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:12.959767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 541/1084] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:13.371175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556355-a6ad-4bcb-a098-0f65e333620a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:13.371719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556355-a6ad-4bcb-a098-0f65e333620a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:13.371719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57556355-a6ad-4bcb-a098-0f65e333620a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:13.373092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 544/1085] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:13.378800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ac37-3c38-44bb-9742-3f4ec7d7910b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:13.379101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ac37-3c38-44bb-9742-3f4ec7d7910b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:13.379383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60ac37-3c38-44bb-9742-3f4ec7d7910b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:13.398308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3a60ac37-3c38-44bb-9742-3f4ec7d7910b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:13.399490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3a60ac37-3c38-44bb-9742-3f4ec7d7910b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:13.427600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:13.470283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 542/1086] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:59:13.744685 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57556355-a6ad-4bcb-a098-0f65e333620a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:13.792940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:13.850768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57556355-a6ad-4bcb-a098-0f65e333620a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:13.868598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591ecb4-40d2-4a15-aac3-47b184f991fe None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:13.868975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591ecb4-40d2-4a15-aac3-47b184f991fe None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:13.869320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591ecb4-40d2-4a15-aac3-47b184f991fe None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:13.870715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 543/1087] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:13.875844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875a23-a523-4ffa-901b-8d0eda143e3a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:13.876134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875a23-a523-4ffa-901b-8d0eda143e3a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:13.876410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a875a23-a523-4ffa-901b-8d0eda143e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:13.884724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106d0f5-f3f1-410b-987f-201b04339022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:13.885357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106d0f5-f3f1-410b-987f-201b04339022 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:13.885638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106d0f5-f3f1-410b-987f-201b04339022 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:13.885912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106d0f5-f3f1-410b-987f-201b04339022 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:13.894557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7a875a23-a523-4ffa-901b-8d0eda143e3a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:13.895756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7a875a23-a523-4ffa-901b-8d0eda143e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:13.896467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f106d0f5-f3f1-410b-987f-201b04339022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f106d0f5-f3f1-410b-987f-201b04339022 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:13.901184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:13.902282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:13.903329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 545/1088] 10.222.0.82 () {56 vars in 1120 bytes} [Mon Aug 29 18:59:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:13.909477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106d0f5-f3f1-410b-987f-201b04339022 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:13.965529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 544/1089] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:59:14.010344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f106d0f5-f3f1-410b-987f-201b04339022 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.018293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:14.044359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.044966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.045250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.045529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.046193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:14.046500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.048027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:14.056153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 546/1090] 10.222.0.82 () {56 vars in 1115 bytes} [Mon Aug 29 18:59:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:14.062051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875a23-a523-4ffa-901b-8d0eda143e3a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.154481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:14.161909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a875a23-a523-4ffa-901b-8d0eda143e3a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.198433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.199062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.199342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.199613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.213360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.214795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:14.229525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:14.230620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:59:14.231530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:14.231530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:14.231530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:14.231530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 545/1091] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:14.236747 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.237195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.338130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd4235-9020-4751-a98f-03208b99cde1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.340598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7247496-b425-412b-95fb-3ea4b9f8abff None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.370861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.371476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.371783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.372062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.372705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:14.373012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.374362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:14.376383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960fad2-6a75-429c-8b7c-e1806ede0974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.377023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fad2-6a75-429c-8b7c-e1806ede0974 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.377306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fad2-6a75-429c-8b7c-e1806ede0974 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.377580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960fad2-6a75-429c-8b7c-e1806ede0974 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.386915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 546/1092] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:14.388135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960fad2-6a75-429c-8b7c-e1806ede0974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f960fad2-6a75-429c-8b7c-e1806ede0974 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:14.393725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:14.394737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:14.395580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:14.396598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.396693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 547/1093] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:14.400532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960fad2-6a75-429c-8b7c-e1806ede0974 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.404361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:14.427898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:14.499989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960fad2-6a75-429c-8b7c-e1806ede0974 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.501885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874f14-1c69-4c14-a128-6c58254c0e10 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.536803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.537475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.537729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.537845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.538078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.538350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.538628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.538924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.539025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:14.539312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.541088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:14.545725 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.547184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:14.550097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 548/1094] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:14.555662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 18:59:14.558637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:14.559650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:14.560660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 547/1095] 10.222.0.82 () {56 vars in 1093 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 18:59:14.565919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.631002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:14.648129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:14.658114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2fef-f74e-4536-973b-8f9d085e3c47 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.665888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2ddc7-86fc-4958-aedc-14b830edd40d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.691472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb101498-d88c-478a-b0b6-ddec82090617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.692122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101498-d88c-478a-b0b6-ddec82090617 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.692397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101498-d88c-478a-b0b6-ddec82090617 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.692696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101498-d88c-478a-b0b6-ddec82090617 None admin] PATH_INFO: `/v3/users/65a3cc3e061b425998a3a41cc5dfe2e4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.693816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb101498-d88c-478a-b0b6-ddec82090617 None admin] RBAC: Authorizing `identity:get_user(user_id=65a3cc3e061b425998a3a41cc5dfe2e4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.695222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb101498-d88c-478a-b0b6-ddec82090617 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:14.697065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 549/1096] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/users/65a3cc3e061b425998a3a41cc5dfe2e4 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:14.699794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.700402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.700683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.700958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.701833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:14.702150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.702874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb101498-d88c-478a-b0b6-ddec82090617 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.704153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:14.721774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 548/1097] 10.222.0.82 () {56 vars in 1133 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:14.727428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:14.804728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb101498-d88c-478a-b0b6-ddec82090617 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.831939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c05055-e3b0-49eb-9fe0-97186c7e356e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:14.840173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf7403-ca8f-4a2f-8ede-749333d2ce2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.840810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf7403-ca8f-4a2f-8ede-749333d2ce2c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.841095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf7403-ca8f-4a2f-8ede-749333d2ce2c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.841364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf7403-ca8f-4a2f-8ede-749333d2ce2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.855342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:14.866039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ead9c-9e5e-46ea-a2df-733e1ba7ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:14.866643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead9c-9e5e-46ea-a2df-733e1ba7ce64 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:14.866923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead9c-9e5e-46ea-a2df-733e1ba7ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:14.867196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ead9c-9e5e-46ea-a2df-733e1ba7ce64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:14.868224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:14.912004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf7403-ca8f-4a2f-8ede-749333d2ce2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.913747 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf7403-ca8f-4a2f-8ede-749333d2ce2c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:14.940680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ead9c-9e5e-46ea-a2df-733e1ba7ce64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:14.942140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ead9c-9e5e-46ea-a2df-733e1ba7ce64 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.016741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 550/1098] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 18:59:15.022350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf7403-ca8f-4a2f-8ede-749333d2ce2c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.042595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 549/1099] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 18:59:15.049159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ead9c-9e5e-46ea-a2df-733e1ba7ce64 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.076940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.085500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.128161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf7403-ca8f-4a2f-8ede-749333d2ce2c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.158702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ead9c-9e5e-46ea-a2df-733e1ba7ce64 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.163356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d3c5d-7675-4ac0-8267-8095cc69b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.164133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3c5d-7675-4ac0-8267-8095cc69b6de None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.164486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3c5d-7675-4ac0-8267-8095cc69b6de None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.164761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3c5d-7675-4ac0-8267-8095cc69b6de None admin] PATH_INFO: `/v3/projects/0242c2742f61415cb0d21e6d6bdb44de` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.165988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d3c5d-7675-4ac0-8267-8095cc69b6de None admin] RBAC: Authorizing `identity:get_project(project_id=0242c2742f61415cb0d21e6d6bdb44de)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.167425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d3c5d-7675-4ac0-8267-8095cc69b6de None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.169211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 551/1100] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/projects/0242c2742f61415cb0d21e6d6bdb44de => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:15.176041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d3c5d-7675-4ac0-8267-8095cc69b6de None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.198142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.198885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.199166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.199455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.210516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.212013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:15.230212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:15.231214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 18:59:15.232189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:15.232189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 18:59:15.232189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:15.232189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 550/1101] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:15.238767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.293222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d3c5d-7675-4ac0-8267-8095cc69b6de None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.322429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.326482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.334010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.334667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.334903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.335185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.335956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=0242c2742f61415cb0d21e6d6bdb44de, user.id=65a3cc3e061b425998a3a41cc5dfe2e4) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:15.336271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.337692 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.344470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 552/1102] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/role_assignments?user.id=65a3cc3e061b425998a3a41cc5dfe2e4&scope.project.id=0242c2742f61415cb0d21e6d6bdb44de&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:15.356962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eace69-55d4-47c7-a2b2-8b01c6cc432b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.395308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.395979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.396267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.396545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.397215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:15.397525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.398931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.413641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 551/1103] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:15.419095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.536532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13426-2e11-49c3-bac7-70b4ecfddcd0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.572382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.573011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.573291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.573564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.580660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.582075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 18:59:15.593136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:15.595494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:15.596706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 553/1104] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:15.600878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.697954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe9de-6321-419b-915b-9ee80164180f None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.731808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac0131-037a-481c-b7fb-c0aa3dfa6a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.732413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0131-037a-481c-b7fb-c0aa3dfa6a2d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.732692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0131-037a-481c-b7fb-c0aa3dfa6a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.732963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac0131-037a-481c-b7fb-c0aa3dfa6a2d None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.733645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac0131-037a-481c-b7fb-c0aa3dfa6a2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:15.733948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac0131-037a-481c-b7fb-c0aa3dfa6a2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.735552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eac0131-037a-481c-b7fb-c0aa3dfa6a2d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.738014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.747109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 552/1105] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:15.754175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:15.803464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:15.855836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c18613-ae22-4bee-8bb3-56ec718f4ada None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:15.893608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fa11d-8fbb-4af3-9f43-0532db5996e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:15.894214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fa11d-8fbb-4af3-9f43-0532db5996e8 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:15.894490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fa11d-8fbb-4af3-9f43-0532db5996e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:15.894759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fa11d-8fbb-4af3-9f43-0532db5996e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:15.895485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fa11d-8fbb-4af3-9f43-0532db5996e8 None admin] RBAC: Adding query filter params (role.id=6aaccad962de418390a21c0bd48f81ec, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=e02a03585caf46fdb09b4a2fdde91a51) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:15.895999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fa11d-8fbb-4af3-9f43-0532db5996e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:15.897405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fa11d-8fbb-4af3-9f43-0532db5996e8 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:15.903184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 554/1106] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:15 2022] GET /identity/v3/role_assignments?user.id=e02a03585caf46fdb09b4a2fdde91a51&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=6aaccad962de418390a21c0bd48f81ec => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:17.355432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76f026-8825-464b-bffc-2bfd2a809f2b None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.355982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76f026-8825-464b-bffc-2bfd2a809f2b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.356094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76f026-8825-464b-bffc-2bfd2a809f2b None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.357338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 553/1107] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:17.363282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f3ed5-a796-4d89-9187-a0db0bf98f58 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.363684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f3ed5-a796-4d89-9187-a0db0bf98f58 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.363878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f3ed5-a796-4d89-9187-a0db0bf98f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.382227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-410f3ed5-a796-4d89-9187-a0db0bf98f58 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:17.383643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-410f3ed5-a796-4d89-9187-a0db0bf98f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:17.450568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 555/1108] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:17.730700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76f026-8825-464b-bffc-2bfd2a809f2b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.829555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76f026-8825-464b-bffc-2bfd2a809f2b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:17.862480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be4a8d-6444-4fc2-a11d-195642343415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:17.863112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4a8d-6444-4fc2-a11d-195642343415 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:17.863395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4a8d-6444-4fc2-a11d-195642343415 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:17.863671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be4a8d-6444-4fc2-a11d-195642343415 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:17.864815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be4a8d-6444-4fc2-a11d-195642343415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:17.866232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be4a8d-6444-4fc2-a11d-195642343415 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:17.867816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 554/1109] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:17.873691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f3ed5-a796-4d89-9187-a0db0bf98f58 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:17.921116 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:17.981351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f3ed5-a796-4d89-9187-a0db0bf98f58 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:18.023518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349228dd-87b3-4ec2-9354-115b63b61777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:18.023986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349228dd-87b3-4ec2-9354-115b63b61777 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:18.024268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349228dd-87b3-4ec2-9354-115b63b61777 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:18.024542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349228dd-87b3-4ec2-9354-115b63b61777 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:18.025205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349228dd-87b3-4ec2-9354-115b63b61777 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:18.026636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349228dd-87b3-4ec2-9354-115b63b61777 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:18.115913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 556/1110] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:17 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:20.119449 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993c6d-a804-478b-8641-a4709c03b0aa None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.120090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993c6d-a804-478b-8641-a4709c03b0aa None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.120090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993c6d-a804-478b-8641-a4709c03b0aa None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.121355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 555/1111] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:20.126569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc3b9-ccb9-4f6b-8a0b-eb279888b075 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.126978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc3b9-ccb9-4f6b-8a0b-eb279888b075 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.127134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc3b9-ccb9-4f6b-8a0b-eb279888b075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.146077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-fd1cc3b9-ccb9-4f6b-8a0b-eb279888b075 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:20.147281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fd1cc3b9-ccb9-4f6b-8a0b-eb279888b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:20.213699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 557/1112] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:20.490298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1993c6d-a804-478b-8641-a4709c03b0aa None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:20.554630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:20.594605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1993c6d-a804-478b-8641-a4709c03b0aa None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:20.628397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909914a-48ec-4e66-ae9a-a1493f18ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:20.629013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909914a-48ec-4e66-ae9a-a1493f18ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.629291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909914a-48ec-4e66-ae9a-a1493f18ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.629563 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909914a-48ec-4e66-ae9a-a1493f18ddd6 None admin] PATH_INFO: `/v3/roles/d2a640c46df448be87633e4dd910c74f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.630930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909914a-48ec-4e66-ae9a-a1493f18ddd6 None admin] RBAC: Authorizing `identity:get_role(role_id=d2a640c46df448be87633e4dd910c74f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:20.632452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909914a-48ec-4e66-ae9a-a1493f18ddd6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:20.633842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 556/1113] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:20 2022] GET /identity/v3/roles/d2a640c46df448be87633e4dd910c74f => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:20.639622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cc3b9-ccb9-4f6b-8a0b-eb279888b075 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:20.669211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:20.735649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cc3b9-ccb9-4f6b-8a0b-eb279888b075 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:20.769245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92075475-a9f9-4945-9ed2-e753fd89dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:20.769912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075475-a9f9-4945-9ed2-e753fd89dc38 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.770191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075475-a9f9-4945-9ed2-e753fd89dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.770463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92075475-a9f9-4945-9ed2-e753fd89dc38 None admin] PATH_INFO: `/v3/users/539a23855ee74c5497d66901cba65a4d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:20.783774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075475-a9f9-4945-9ed2-e753fd89dc38 None admin] RBAC: Authorizing `identity:get_user(user_id=539a23855ee74c5497d66901cba65a4d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:20.785336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92075475-a9f9-4945-9ed2-e753fd89dc38 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:20.786913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 558/1114] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:20 2022] GET /identity/v3/users/539a23855ee74c5497d66901cba65a4d => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:20.792697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909914a-48ec-4e66-ae9a-a1493f18ddd6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:20.893296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909914a-48ec-4e66-ae9a-a1493f18ddd6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:20.928232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:20.933633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a132547-badc-48f6-a055-e8a59186b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:20.934243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132547-badc-48f6-a055-e8a59186b158 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:20.934524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132547-badc-48f6-a055-e8a59186b158 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:20.934797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a132547-badc-48f6-a055-e8a59186b158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.003662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a132547-badc-48f6-a055-e8a59186b158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:21.006109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a132547-badc-48f6-a055-e8a59186b158 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:21.107366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 557/1115] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:21.113512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92075475-a9f9-4945-9ed2-e753fd89dc38 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.200709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:21.216439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92075475-a9f9-4945-9ed2-e753fd89dc38 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:21.252757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adbbef-f4ca-451d-beec-94baced65216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:21.253387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adbbef-f4ca-451d-beec-94baced65216 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.253723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adbbef-f4ca-451d-beec-94baced65216 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.253999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adbbef-f4ca-451d-beec-94baced65216 None admin] PATH_INFO: `/v3/projects/0242c2742f61415cb0d21e6d6bdb44de` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.255089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adbbef-f4ca-451d-beec-94baced65216 None admin] RBAC: Authorizing `identity:get_project(project_id=0242c2742f61415cb0d21e6d6bdb44de)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:21.256523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45adbbef-f4ca-451d-beec-94baced65216 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:21.258131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 559/1116] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/projects/0242c2742f61415cb0d21e6d6bdb44de => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:21.264253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a132547-badc-48f6-a055-e8a59186b158 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:21.295283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:21.369012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a132547-badc-48f6-a055-e8a59186b158 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:21.404053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f84f2-f1c6-4fbe-98d6-232f2c4f7d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:21.404656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f84f2-f1c6-4fbe-98d6-232f2c4f7d1b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:21.404954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f84f2-f1c6-4fbe-98d6-232f2c4f7d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:21.405259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f84f2-f1c6-4fbe-98d6-232f2c4f7d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:21.406037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f84f2-f1c6-4fbe-98d6-232f2c4f7d1b None admin] RBAC: Adding query filter params (role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=0242c2742f61415cb0d21e6d6bdb44de, user.id=539a23855ee74c5497d66901cba65a4d) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:21.406396 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f84f2-f1c6-4fbe-98d6-232f2c4f7d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:21.407858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f84f2-f1c6-4fbe-98d6-232f2c4f7d1b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:21.413300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 558/1117] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:21 2022] GET /identity/v3/role_assignments?user.id=539a23855ee74c5497d66901cba65a4d&scope.project.id=0242c2742f61415cb0d21e6d6bdb44de&role.id=d2a640c46df448be87633e4dd910c74f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:23.324634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f822dfb-b9da-4e0f-a4e4-372f89afcbfb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.325195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f822dfb-b9da-4e0f-a4e4-372f89afcbfb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.325195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f822dfb-b9da-4e0f-a4e4-372f89afcbfb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.326503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 560/1118] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:23.333177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1a4c-2cd9-47d2-8cee-59e394871632 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.333662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1a4c-2cd9-47d2-8cee-59e394871632 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.333873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea1a4c-2cd9-47d2-8cee-59e394871632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.358679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-75ea1a4c-2cd9-47d2-8cee-59e394871632 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:23.360806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-75ea1a4c-2cd9-47d2-8cee-59e394871632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:23.439432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 559/1119] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:23.720457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f822dfb-b9da-4e0f-a4e4-372f89afcbfb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:23.831790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f822dfb-b9da-4e0f-a4e4-372f89afcbfb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:23.867468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d69767-0b89-4730-bf42-f62e91f2b6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:23.868121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69767-0b89-4730-bf42-f62e91f2b6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:23.868402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69767-0b89-4730-bf42-f62e91f2b6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:23.868679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d69767-0b89-4730-bf42-f62e91f2b6f7 None admin] PATH_INFO: `/v3/roles/d2a640c46df448be87633e4dd910c74f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:23.870110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d69767-0b89-4730-bf42-f62e91f2b6f7 None admin] RBAC: Authorizing `identity:get_role(role_id=d2a640c46df448be87633e4dd910c74f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:23.871474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d69767-0b89-4730-bf42-f62e91f2b6f7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:23.872834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 561/1120] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:23 2022] GET /identity/v3/roles/d2a640c46df448be87633e4dd910c74f => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:23.880139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea1a4c-2cd9-47d2-8cee-59e394871632 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:23.907568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:23.996581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea1a4c-2cd9-47d2-8cee-59e394871632 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.035605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a76257-e0b0-4450-9825-efb8ca0ccf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.036444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76257-e0b0-4450-9825-efb8ca0ccf02 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.037706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76257-e0b0-4450-9825-efb8ca0ccf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.038016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a76257-e0b0-4450-9825-efb8ca0ccf02 None admin] PATH_INFO: `/v3/users/539a23855ee74c5497d66901cba65a4d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.039168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a76257-e0b0-4450-9825-efb8ca0ccf02 None admin] RBAC: Authorizing `identity:get_user(user_id=539a23855ee74c5497d66901cba65a4d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:24.040637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a76257-e0b0-4450-9825-efb8ca0ccf02 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:24.042249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 560/1121] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:23 2022] GET /identity/v3/users/539a23855ee74c5497d66901cba65a4d => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:24.048765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d69767-0b89-4730-bf42-f62e91f2b6f7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:24.078743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:24.157504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d69767-0b89-4730-bf42-f62e91f2b6f7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.191699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed599ce-7906-4aec-b23e-67ace1771d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.192350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed599ce-7906-4aec-b23e-67ace1771d8d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.192636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed599ce-7906-4aec-b23e-67ace1771d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.192915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed599ce-7906-4aec-b23e-67ace1771d8d None admin] PATH_INFO: `/v3/projects/0242c2742f61415cb0d21e6d6bdb44de` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.194034 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed599ce-7906-4aec-b23e-67ace1771d8d None admin] RBAC: Authorizing `identity:get_project(project_id=0242c2742f61415cb0d21e6d6bdb44de)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:24.195451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed599ce-7906-4aec-b23e-67ace1771d8d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:24.197375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 562/1122] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:24 2022] GET /identity/v3/projects/0242c2742f61415cb0d21e6d6bdb44de => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:24.204226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a76257-e0b0-4450-9825-efb8ca0ccf02 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:24.293769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:24.300353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a76257-e0b0-4450-9825-efb8ca0ccf02 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:24.334907 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95708dcf-f442-4611-a6f1-c6bfd39b1668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:24.335557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95708dcf-f442-4611-a6f1-c6bfd39b1668 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:24.335870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95708dcf-f442-4611-a6f1-c6bfd39b1668 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:24.336146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95708dcf-f442-4611-a6f1-c6bfd39b1668 None admin] PATH_INFO: `/v3/projects/0242c2742f61415cb0d21e6d6bdb44de/users/539a23855ee74c5497d66901cba65a4d/roles/d2a640c46df448be87633e4dd910c74f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:24.338267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95708dcf-f442-4611-a6f1-c6bfd39b1668 None admin] RBAC: Authorizing `identity:create_grant(project_id=0242c2742f61415cb0d21e6d6bdb44de, user_id=539a23855ee74c5497d66901cba65a4d, role_id=d2a640c46df448be87633e4dd910c74f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:24.339684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95708dcf-f442-4611-a6f1-c6bfd39b1668 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:24.418110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 561/1123] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:24 2022] PUT /identity/v3/projects/0242c2742f61415cb0d21e6d6bdb44de/users/539a23855ee74c5497d66901cba65a4d/roles/d2a640c46df448be87633e4dd910c74f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:26.318923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8389-3bee-4bab-abeb-89922cfa2069 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.319480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8389-3bee-4bab-abeb-89922cfa2069 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.319480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8389-3bee-4bab-abeb-89922cfa2069 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.320862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 563/1124] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:26.326298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4441d-23b7-4d1c-8f79-a8b66fa7fefd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.326721 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4441d-23b7-4d1c-8f79-a8b66fa7fefd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.326826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4441d-23b7-4d1c-8f79-a8b66fa7fefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.345514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-03a4441d-23b7-4d1c-8f79-a8b66fa7fefd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:26.346704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-03a4441d-23b7-4d1c-8f79-a8b66fa7fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:26.412493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 562/1125] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:26.694776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8389-3bee-4bab-abeb-89922cfa2069 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:26.787960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:26.798114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8389-3bee-4bab-abeb-89922cfa2069 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:26.831769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebfff6-e32e-4218-b9f8-b1d408c26559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:26.832394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfff6-e32e-4218-b9f8-b1d408c26559 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.832677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfff6-e32e-4218-b9f8-b1d408c26559 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.832950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfff6-e32e-4218-b9f8-b1d408c26559 None admin] PATH_INFO: `/v3/roles/d2a640c46df448be87633e4dd910c74f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.834574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebfff6-e32e-4218-b9f8-b1d408c26559 None admin] RBAC: Authorizing `identity:get_role(role_id=d2a640c46df448be87633e4dd910c74f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:26.836558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebfff6-e32e-4218-b9f8-b1d408c26559 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:26.837876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 564/1126] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:26 2022] GET /identity/v3/roles/d2a640c46df448be87633e4dd910c74f => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:26.843790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4441d-23b7-4d1c-8f79-a8b66fa7fefd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:26.924576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:26.940542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4441d-23b7-4d1c-8f79-a8b66fa7fefd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:26.973939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966fcde-3f2a-4384-aa48-e598d9644935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:26.974567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966fcde-3f2a-4384-aa48-e598d9644935 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:26.974851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966fcde-3f2a-4384-aa48-e598d9644935 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:26.975127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966fcde-3f2a-4384-aa48-e598d9644935 None admin] PATH_INFO: `/v3/users/539a23855ee74c5497d66901cba65a4d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:26.976269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966fcde-3f2a-4384-aa48-e598d9644935 None admin] RBAC: Authorizing `identity:get_user(user_id=539a23855ee74c5497d66901cba65a4d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:26.977690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966fcde-3f2a-4384-aa48-e598d9644935 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:26.979254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 563/1127] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:26 2022] GET /identity/v3/users/539a23855ee74c5497d66901cba65a4d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:26.985769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebfff6-e32e-4218-b9f8-b1d408c26559 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.082736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebfff6-e32e-4218-b9f8-b1d408c26559 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.124896 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecef1c-857c-4687-8065-b9291ebe32dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.126317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecef1c-857c-4687-8065-b9291ebe32dd None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.126601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecef1c-857c-4687-8065-b9291ebe32dd None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.126872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecef1c-857c-4687-8065-b9291ebe32dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.163595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:27.203612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecef1c-857c-4687-8065-b9291ebe32dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.205159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecef1c-857c-4687-8065-b9291ebe32dd None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.303233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 565/1128] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:27.309218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966fcde-3f2a-4384-aa48-e598d9644935 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.408508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966fcde-3f2a-4384-aa48-e598d9644935 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.442829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a122e78-f95d-4db5-9a5e-ee412fa9f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.443460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122e78-f95d-4db5-9a5e-ee412fa9f542 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.443822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122e78-f95d-4db5-9a5e-ee412fa9f542 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.444080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a122e78-f95d-4db5-9a5e-ee412fa9f542 None admin] PATH_INFO: `/v3/projects/0242c2742f61415cb0d21e6d6bdb44de` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.445261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a122e78-f95d-4db5-9a5e-ee412fa9f542 None admin] RBAC: Authorizing `identity:get_project(project_id=0242c2742f61415cb0d21e6d6bdb44de)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.446939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a122e78-f95d-4db5-9a5e-ee412fa9f542 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.448599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 564/1129] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:27 2022] GET /identity/v3/projects/0242c2742f61415cb0d21e6d6bdb44de => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:27.454802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecef1c-857c-4687-8065-b9291ebe32dd None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:27.512613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:27.552300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecef1c-857c-4687-8065-b9291ebe32dd None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:27.585359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92abad-c15e-45cd-80ac-ae416661cfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:27.585891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92abad-c15e-45cd-80ac-ae416661cfa5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:27.586175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92abad-c15e-45cd-80ac-ae416661cfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:27.586451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92abad-c15e-45cd-80ac-ae416661cfa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:27.587175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92abad-c15e-45cd-80ac-ae416661cfa5 None admin] RBAC: Adding query filter params (role.id=d2a640c46df448be87633e4dd910c74f, scope.project.id=0242c2742f61415cb0d21e6d6bdb44de, user.id=539a23855ee74c5497d66901cba65a4d) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:27.587483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92abad-c15e-45cd-80ac-ae416661cfa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:27.588934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92abad-c15e-45cd-80ac-ae416661cfa5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:27.594535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 566/1130] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:27 2022] GET /identity/v3/role_assignments?user.id=539a23855ee74c5497d66901cba65a4d&scope.project.id=0242c2742f61415cb0d21e6d6bdb44de&role.id=d2a640c46df448be87633e4dd910c74f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:29.551928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd5a85-5371-4207-bd0e-b7d1166cf41b None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:29.552461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd5a85-5371-4207-bd0e-b7d1166cf41b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:29.552461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd5a85-5371-4207-bd0e-b7d1166cf41b None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:29.553815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 565/1131] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:29.558914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596f1e5-764f-4ca3-8091-d16b724a89c0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:29.559358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596f1e5-764f-4ca3-8091-d16b724a89c0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:29.559473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596f1e5-764f-4ca3-8091-d16b724a89c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:29.577765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f596f1e5-764f-4ca3-8091-d16b724a89c0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:29.579633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f596f1e5-764f-4ca3-8091-d16b724a89c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:29.646946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 567/1132] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:29.915436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd5a85-5371-4207-bd0e-b7d1166cf41b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:29.936278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:30.013960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd5a85-5371-4207-bd0e-b7d1166cf41b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:30.046651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef456425-f06f-4a2a-8e4e-93dd6e47efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:30.047364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456425-f06f-4a2a-8e4e-93dd6e47efd6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:30.047646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456425-f06f-4a2a-8e4e-93dd6e47efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:30.047947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef456425-f06f-4a2a-8e4e-93dd6e47efd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:30.049051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef456425-f06f-4a2a-8e4e-93dd6e47efd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:30.050464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef456425-f06f-4a2a-8e4e-93dd6e47efd6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:30.052043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 566/1133] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:30.059250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596f1e5-764f-4ca3-8091-d16b724a89c0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:30.116268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:30.162358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596f1e5-764f-4ca3-8091-d16b724a89c0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:30.197333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae8111-49c9-41aa-9a3a-efc33c180c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:30.197854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8111-49c9-41aa-9a3a-efc33c180c41 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:30.198130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8111-49c9-41aa-9a3a-efc33c180c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:30.198401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae8111-49c9-41aa-9a3a-efc33c180c41 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:30.199039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae8111-49c9-41aa-9a3a-efc33c180c41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:30.200482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae8111-49c9-41aa-9a3a-efc33c180c41 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:30.308732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 568/1134] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:59:30 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:32.274284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce097-94d3-4a3e-a5b7-c4451375009f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.274823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce097-94d3-4a3e-a5b7-c4451375009f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.274823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ce097-94d3-4a3e-a5b7-c4451375009f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.276196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 567/1135] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:32.281293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90542-aa7f-4786-a6b1-0e314dd50242 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.281806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90542-aa7f-4786-a6b1-0e314dd50242 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.281894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc90542-aa7f-4786-a6b1-0e314dd50242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.299465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9bc90542-aa7f-4786-a6b1-0e314dd50242 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:32.300686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9bc90542-aa7f-4786-a6b1-0e314dd50242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:32.366452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 569/1136] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:32.639340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce097-94d3-4a3e-a5b7-c4451375009f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:32.726947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:32.743478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ce097-94d3-4a3e-a5b7-c4451375009f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:32.777743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229c370-fd91-421b-a3ff-5a5f0c297316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:32.778371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c370-fd91-421b-a3ff-5a5f0c297316 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.778655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c370-fd91-421b-a3ff-5a5f0c297316 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.778929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c370-fd91-421b-a3ff-5a5f0c297316 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.780067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229c370-fd91-421b-a3ff-5a5f0c297316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:32.781686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229c370-fd91-421b-a3ff-5a5f0c297316 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:32.783252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 568/1137] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 18:59:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:32.789012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc90542-aa7f-4786-a6b1-0e314dd50242 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:32.824081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:32.888846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc90542-aa7f-4786-a6b1-0e314dd50242 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:32.922259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d80973-5659-4bf2-a2c7-08e7a66cb180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:32.922923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80973-5659-4bf2-a2c7-08e7a66cb180 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:32.923206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80973-5659-4bf2-a2c7-08e7a66cb180 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:32.923483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d80973-5659-4bf2-a2c7-08e7a66cb180 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:32.924163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d80973-5659-4bf2-a2c7-08e7a66cb180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:32.925590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d80973-5659-4bf2-a2c7-08e7a66cb180 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:33.023578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 570/1138] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:32 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:35.002243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511ce9-5719-47b5-ac44-6b4fe0a9aa39 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.002797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511ce9-5719-47b5-ac44-6b4fe0a9aa39 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.002797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c511ce9-5719-47b5-ac44-6b4fe0a9aa39 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.004161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 569/1139] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 18:59:35.009266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc143-b898-459b-b211-72b8a4155714 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.009674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc143-b898-459b-b211-72b8a4155714 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.009822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afc143-b898-459b-b211-72b8a4155714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.028428 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-21afc143-b898-459b-b211-72b8a4155714 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:35.029607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-21afc143-b898-459b-b211-72b8a4155714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:35.096522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 571/1140] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:35.371374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c511ce9-5719-47b5-ac44-6b4fe0a9aa39 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:35.472105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c511ce9-5719-47b5-ac44-6b4fe0a9aa39 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.507585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b25bc-815c-4b4c-92c7-313a50ecf8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.508245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b25bc-815c-4b4c-92c7-313a50ecf8bd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.508524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b25bc-815c-4b4c-92c7-313a50ecf8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.508799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b25bc-815c-4b4c-92c7-313a50ecf8bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.519427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b25bc-815c-4b4c-92c7-313a50ecf8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-870b25bc-815c-4b4c-92c7-313a50ecf8bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:35.524243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:35.525415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:35.526740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 570/1141] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:35.531518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afc143-b898-459b-b211-72b8a4155714 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:35.555152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:35.631338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afc143-b898-459b-b211-72b8a4155714 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.664342 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.664944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.665228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.665509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.666168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:35.666473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:35.667863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:35.676726 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 572/1142] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:35.682560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b25bc-815c-4b4c-92c7-313a50ecf8bd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:35.701785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:35.780753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b25bc-815c-4b4c-92c7-313a50ecf8bd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.814648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d6cc-29eb-4401-bbac-1ad84156d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.815288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d6cc-29eb-4401-bbac-1ad84156d448 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.815656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d6cc-29eb-4401-bbac-1ad84156d448 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.815966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d6cc-29eb-4401-bbac-1ad84156d448 None admin] PATH_INFO: `/v3/users/d38b0f3e415343cf9fcaf95ab1af11e6` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:35.829866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d6cc-29eb-4401-bbac-1ad84156d448 None admin] RBAC: Authorizing `identity:get_user(user_id=d38b0f3e415343cf9fcaf95ab1af11e6)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:35.831293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d6cc-29eb-4401-bbac-1ad84156d448 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:35.832975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 571/1143] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:35 2022] GET /identity/v3/users/d38b0f3e415343cf9fcaf95ab1af11e6 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:35.838914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:35.921645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:35.938990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095f907-df78-464e-b47b-e7ea8b001520 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:35.973599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b221187-07cd-44ce-979b-72c31f604f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:35.974197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221187-07cd-44ce-979b-72c31f604f58 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:35.974477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221187-07cd-44ce-979b-72c31f604f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:35.974750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b221187-07cd-44ce-979b-72c31f604f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:36.041203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b221187-07cd-44ce-979b-72c31f604f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:36.042639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b221187-07cd-44ce-979b-72c31f604f58 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:36.123352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:36.139152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 573/1144] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:36.145848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d6cc-29eb-4401-bbac-1ad84156d448 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:36.223980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:36.248484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d6cc-29eb-4401-bbac-1ad84156d448 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:36.281201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9097f4e-802d-4054-83dc-b8facf4fb1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:36.282370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097f4e-802d-4054-83dc-b8facf4fb1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:36.282652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097f4e-802d-4054-83dc-b8facf4fb1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:36.282927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9097f4e-802d-4054-83dc-b8facf4fb1f2 None admin] PATH_INFO: `/v3/projects/e4da8d1039854f14a08cd9e94c59ca04` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:36.284066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9097f4e-802d-4054-83dc-b8facf4fb1f2 None admin] RBAC: Authorizing `identity:get_project(project_id=e4da8d1039854f14a08cd9e94c59ca04)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:36.285486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9097f4e-802d-4054-83dc-b8facf4fb1f2 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:36.287118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 572/1145] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:36 2022] GET /identity/v3/projects/e4da8d1039854f14a08cd9e94c59ca04 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:36.293312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b221187-07cd-44ce-979b-72c31f604f58 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:36.390719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b221187-07cd-44ce-979b-72c31f604f58 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:36.424315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a0922-0f03-46cf-a4cc-43641f2bd3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:36.424919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0922-0f03-46cf-a4cc-43641f2bd3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:36.425198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0922-0f03-46cf-a4cc-43641f2bd3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:36.425490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a0922-0f03-46cf-a4cc-43641f2bd3b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:36.426211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a0922-0f03-46cf-a4cc-43641f2bd3b5 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=e4da8d1039854f14a08cd9e94c59ca04, user.id=d38b0f3e415343cf9fcaf95ab1af11e6) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:36.426522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a0922-0f03-46cf-a4cc-43641f2bd3b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:36.428012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a0922-0f03-46cf-a4cc-43641f2bd3b5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:36.433592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 574/1146] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:36 2022] GET /identity/v3/role_assignments?user.id=d38b0f3e415343cf9fcaf95ab1af11e6&scope.project.id=e4da8d1039854f14a08cd9e94c59ca04&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:38.336059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eacde-1720-404c-9df9-6dc8a423b433 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.336585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eacde-1720-404c-9df9-6dc8a423b433 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.336585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7eacde-1720-404c-9df9-6dc8a423b433 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.337949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 573/1147] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:38.343099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d31aa-b2ac-4377-b0c0-84e38bf67d3a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.343531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d31aa-b2ac-4377-b0c0-84e38bf67d3a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.343677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d31aa-b2ac-4377-b0c0-84e38bf67d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.362232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c82d31aa-b2ac-4377-b0c0-84e38bf67d3a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:38.363523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c82d31aa-b2ac-4377-b0c0-84e38bf67d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:38.407441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:38.429499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 575/1148] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:38.706099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7eacde-1720-404c-9df9-6dc8a423b433 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.804830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7eacde-1720-404c-9df9-6dc8a423b433 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.842029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e778-fe11-4250-90ae-a1cfe32bf055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:38.842650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e778-fe11-4250-90ae-a1cfe32bf055 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:38.842929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e778-fe11-4250-90ae-a1cfe32bf055 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:38.843200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9e778-fe11-4250-90ae-a1cfe32bf055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:38.853494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9e778-fe11-4250-90ae-a1cfe32bf055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a1d9e778-fe11-4250-90ae-a1cfe32bf055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:38.858251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:38.859437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:38.861682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 574/1149] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:38.866349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d31aa-b2ac-4377-b0c0-84e38bf67d3a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:38.964685 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d31aa-b2ac-4377-b0c0-84e38bf67d3a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:38.999380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.000004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.000326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.000592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.001338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:39.001641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.002992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.010892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 576/1150] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:39.016921 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e778-fe11-4250-90ae-a1cfe32bf055 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:39.020331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:39.113520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9e778-fe11-4250-90ae-a1cfe32bf055 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:39.146525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2874a-0723-44d1-984a-7964fcd3dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.147148 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2874a-0723-44d1-984a-7964fcd3dabd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.147425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2874a-0723-44d1-984a-7964fcd3dabd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.147694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2874a-0723-44d1-984a-7964fcd3dabd None admin] PATH_INFO: `/v3/users/d38b0f3e415343cf9fcaf95ab1af11e6` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.148828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2874a-0723-44d1-984a-7964fcd3dabd None admin] RBAC: Authorizing `identity:get_user(user_id=d38b0f3e415343cf9fcaf95ab1af11e6)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.150393 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2874a-0723-44d1-984a-7964fcd3dabd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.151979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 575/1151] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:39 2022] GET /identity/v3/users/d38b0f3e415343cf9fcaf95ab1af11e6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 18:59:39.157873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:39.198835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:39.258324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a90b7-18a2-42ef-ad40-fbfd1fbb7eb3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:39.291642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fce0a-d334-475f-a17a-5ddd4f49a5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.292281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fce0a-d334-475f-a17a-5ddd4f49a5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.292561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fce0a-d334-475f-a17a-5ddd4f49a5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.292834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fce0a-d334-475f-a17a-5ddd4f49a5d4 None admin] PATH_INFO: `/v3/projects/e4da8d1039854f14a08cd9e94c59ca04` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.293920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fce0a-d334-475f-a17a-5ddd4f49a5d4 None admin] RBAC: Authorizing `identity:get_project(project_id=e4da8d1039854f14a08cd9e94c59ca04)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.295328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fce0a-d334-475f-a17a-5ddd4f49a5d4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.296971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 577/1152] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:39 2022] GET /identity/v3/projects/e4da8d1039854f14a08cd9e94c59ca04 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:39.303151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2874a-0723-44d1-984a-7964fcd3dabd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:39.371840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:39.402558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2874a-0723-44d1-984a-7964fcd3dabd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:39.438473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcf25a-28cd-46d7-8d96-5e33a9d391e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:39.439074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf25a-28cd-46d7-8d96-5e33a9d391e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:39.439354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf25a-28cd-46d7-8d96-5e33a9d391e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:39.439623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcf25a-28cd-46d7-8d96-5e33a9d391e8 None admin] PATH_INFO: `/v3/projects/e4da8d1039854f14a08cd9e94c59ca04/users/d38b0f3e415343cf9fcaf95ab1af11e6/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:39.441523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcf25a-28cd-46d7-8d96-5e33a9d391e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4da8d1039854f14a08cd9e94c59ca04, user_id=d38b0f3e415343cf9fcaf95ab1af11e6, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:39.442932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcf25a-28cd-46d7-8d96-5e33a9d391e8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:39.543629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 576/1153] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:39 2022] PUT /identity/v3/projects/e4da8d1039854f14a08cd9e94c59ca04/users/d38b0f3e415343cf9fcaf95ab1af11e6/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 18:59:41.439051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac48a8-a4e1-4b1b-bcb1-f9b189cefe25 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.439574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac48a8-a4e1-4b1b-bcb1-f9b189cefe25 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.439574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac48a8-a4e1-4b1b-bcb1-f9b189cefe25 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.440960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 578/1154] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:41.446078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652413c1-5161-4a43-afdb-f602d0c452b9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.446766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652413c1-5161-4a43-afdb-f602d0c452b9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.446997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652413c1-5161-4a43-afdb-f602d0c452b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.467736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-652413c1-5161-4a43-afdb-f602d0c452b9 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:41.468981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-652413c1-5161-4a43-afdb-f602d0c452b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:41.533782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 577/1155] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:41.802120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac48a8-a4e1-4b1b-bcb1-f9b189cefe25 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:41.902093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac48a8-a4e1-4b1b-bcb1-f9b189cefe25 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:41.910909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:41.934894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3110d-5247-4929-ac52-355bdc79d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:41.935513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3110d-5247-4929-ac52-355bdc79d364 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:41.935819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3110d-5247-4929-ac52-355bdc79d364 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:41.936091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3110d-5247-4929-ac52-355bdc79d364 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:41.946401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3110d-5247-4929-ac52-355bdc79d364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-ade3110d-5247-4929-ac52-355bdc79d364 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:41.951479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:41.952601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:41.953873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 579/1156] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:41.958678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652413c1-5161-4a43-afdb-f602d0c452b9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.015268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.055443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652413c1-5161-4a43-afdb-f602d0c452b9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.089036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.089640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.089924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.090200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.090860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:42.091165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.092545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.101414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 578/1157] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:42.107485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3110d-5247-4929-ac52-355bdc79d364 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.206797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3110d-5247-4929-ac52-355bdc79d364 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.240954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a65051-11da-490b-a9e4-e058ec4ef66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.241598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65051-11da-490b-a9e4-e058ec4ef66e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.241867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65051-11da-490b-a9e4-e058ec4ef66e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.242145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a65051-11da-490b-a9e4-e058ec4ef66e None admin] PATH_INFO: `/v3/users/d38b0f3e415343cf9fcaf95ab1af11e6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.243269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a65051-11da-490b-a9e4-e058ec4ef66e None admin] RBAC: Authorizing `identity:get_user(user_id=d38b0f3e415343cf9fcaf95ab1af11e6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.244719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a65051-11da-490b-a9e4-e058ec4ef66e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.246287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 580/1158] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/users/d38b0f3e415343cf9fcaf95ab1af11e6 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:42.252394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.359867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84eecc-4605-4e3d-940f-cccdd0cc522e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.382983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.394636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854218b2-5a1c-4790-bcf2-ac934a27c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.399423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854218b2-5a1c-4790-bcf2-ac934a27c466 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.399423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854218b2-5a1c-4790-bcf2-ac934a27c466 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.399423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854218b2-5a1c-4790-bcf2-ac934a27c466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.464485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854218b2-5a1c-4790-bcf2-ac934a27c466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.465942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854218b2-5a1c-4790-bcf2-ac934a27c466 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.562715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 579/1159] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:42.568639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a65051-11da-490b-a9e4-e058ec4ef66e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.604953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.672733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a65051-11da-490b-a9e4-e058ec4ef66e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.706588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c828a39-2df1-4bbb-91e7-f910b7837163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.707211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828a39-2df1-4bbb-91e7-f910b7837163 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.707490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828a39-2df1-4bbb-91e7-f910b7837163 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.707784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c828a39-2df1-4bbb-91e7-f910b7837163 None admin] PATH_INFO: `/v3/projects/e4da8d1039854f14a08cd9e94c59ca04` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.708891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c828a39-2df1-4bbb-91e7-f910b7837163 None admin] RBAC: Authorizing `identity:get_project(project_id=e4da8d1039854f14a08cd9e94c59ca04)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.710343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c828a39-2df1-4bbb-91e7-f910b7837163 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.711974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 581/1160] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/projects/e4da8d1039854f14a08cd9e94c59ca04 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:42.718143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854218b2-5a1c-4790-bcf2-ac934a27c466 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:42.742167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:42.816055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854218b2-5a1c-4790-bcf2-ac934a27c466 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:42.849353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ff373-bac7-43b2-b663-fb7b41fa6ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:42.849956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff373-bac7-43b2-b663-fb7b41fa6ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:42.850241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff373-bac7-43b2-b663-fb7b41fa6ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:42.850521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ff373-bac7-43b2-b663-fb7b41fa6ff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:42.851245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ff373-bac7-43b2-b663-fb7b41fa6ff6 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=e4da8d1039854f14a08cd9e94c59ca04, user.id=d38b0f3e415343cf9fcaf95ab1af11e6) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:42.851558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ff373-bac7-43b2-b663-fb7b41fa6ff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:42.853004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ff373-bac7-43b2-b663-fb7b41fa6ff6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:42.858643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 580/1161] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:42 2022] GET /identity/v3/role_assignments?user.id=d38b0f3e415343cf9fcaf95ab1af11e6&scope.project.id=e4da8d1039854f14a08cd9e94c59ca04&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:44.805557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd771c-f3f5-465a-9585-efbb01fb84cc None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:44.806096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd771c-f3f5-465a-9585-efbb01fb84cc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:44.806096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd771c-f3f5-465a-9585-efbb01fb84cc None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:44.807462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 582/1162] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:44.812717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06ba1-4762-4ad1-ac12-9a27d1c8a366 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:44.813275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06ba1-4762-4ad1-ac12-9a27d1c8a366 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:44.813381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06ba1-4762-4ad1-ac12-9a27d1c8a366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:44.831993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cbe06ba1-4762-4ad1-ac12-9a27d1c8a366 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:44.833202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cbe06ba1-4762-4ad1-ac12-9a27d1c8a366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:44.902168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 581/1163] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:45.174643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd771c-f3f5-465a-9585-efbb01fb84cc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:45.275257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd771c-f3f5-465a-9585-efbb01fb84cc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:45.277561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:45.307931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929cad4-5032-4c19-8be5-ea849ff52d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:45.308780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929cad4-5032-4c19-8be5-ea849ff52d09 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.309269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929cad4-5032-4c19-8be5-ea849ff52d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.309850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929cad4-5032-4c19-8be5-ea849ff52d09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.380457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929cad4-5032-4c19-8be5-ea849ff52d09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:45.381905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929cad4-5032-4c19-8be5-ea849ff52d09 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:45.479175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 583/1164] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:45.486261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06ba1-4762-4ad1-ac12-9a27d1c8a366 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:45.503697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:45.582191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06ba1-4762-4ad1-ac12-9a27d1c8a366 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:45.614910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b146bbf-d257-407e-a2b4-45893aa43da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:45.615533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146bbf-d257-407e-a2b4-45893aa43da8 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.615847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146bbf-d257-407e-a2b4-45893aa43da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.616127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146bbf-d257-407e-a2b4-45893aa43da8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.622519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b146bbf-d257-407e-a2b4-45893aa43da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:45.624023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b146bbf-d257-407e-a2b4-45893aa43da8 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-7b146bbf-d257-407e-a2b4-45893aa43da8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:45.635763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:45.636996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 18:59:45.638111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 582/1165] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 18:59:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:45.643117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929cad4-5032-4c19-8be5-ea849ff52d09 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:45.646400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:45.742085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929cad4-5032-4c19-8be5-ea849ff52d09 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:45.775422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ddb9e-c5b0-4971-86bc-f2a5db059a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:45.776050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ddb9e-c5b0-4971-86bc-f2a5db059a5e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:45.776336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ddb9e-c5b0-4971-86bc-f2a5db059a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:45.776613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ddb9e-c5b0-4971-86bc-f2a5db059a5e None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:45.777253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ddb9e-c5b0-4971-86bc-f2a5db059a5e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:45.777557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ddb9e-c5b0-4971-86bc-f2a5db059a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:45.778922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ddb9e-c5b0-4971-86bc-f2a5db059a5e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:45.786507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 584/1166] 10.222.0.82 () {56 vars in 1115 bytes} [Mon Aug 29 18:59:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:47.692329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84329-5509-4611-9c26-c9fc2cb71c61 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.692863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84329-5509-4611-9c26-c9fc2cb71c61 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.692863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84329-5509-4611-9c26-c9fc2cb71c61 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.694199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 583/1167] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:47.699870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fbad8-aa66-4eb0-8d63-9a7de6a425be None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:47.700286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fbad8-aa66-4eb0-8d63-9a7de6a425be None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:47.700418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fbad8-aa66-4eb0-8d63-9a7de6a425be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:47.719632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-230fbad8-aa66-4eb0-8d63-9a7de6a425be None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:47.720822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-230fbad8-aa66-4eb0-8d63-9a7de6a425be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:47.782383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:47.788432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 585/1168] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:59:48.059235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd84329-5509-4611-9c26-c9fc2cb71c61 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:48.134422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:48.158395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd84329-5509-4611-9c26-c9fc2cb71c61 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:48.192646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f3f1b-102d-4fc3-b648-2877e9830c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:48.193251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3f1b-102d-4fc3-b648-2877e9830c00 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:48.193532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3f1b-102d-4fc3-b648-2877e9830c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:48.193805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f3f1b-102d-4fc3-b648-2877e9830c00 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:48.194478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f3f1b-102d-4fc3-b648-2877e9830c00 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:48.195852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f3f1b-102d-4fc3-b648-2877e9830c00 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:48.264584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 584/1169] 10.222.0.82 () {60 vars in 1138 bytes} [Mon Aug 29 18:59:48 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:50.224404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c686-797a-4672-abc4-a92e8e68e228 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.224917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c686-797a-4672-abc4-a92e8e68e228 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.225026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c686-797a-4672-abc4-a92e8e68e228 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.226278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 586/1170] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:50.231525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520a2b-fcd3-4767-ae83-b365eec734ef None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.231995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520a2b-fcd3-4767-ae83-b365eec734ef None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.232126 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7520a2b-fcd3-4767-ae83-b365eec734ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.250583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c7520a2b-fcd3-4767-ae83-b365eec734ef None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:50.251813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c7520a2b-fcd3-4767-ae83-b365eec734ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:50.319319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 585/1171] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:50.594568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634c686-797a-4672-abc4-a92e8e68e228 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:50.709121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634c686-797a-4672-abc4-a92e8e68e228 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:50.742159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399a70e-8c88-418a-8134-b6a76126d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:50.742778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399a70e-8c88-418a-8134-b6a76126d218 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.743062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399a70e-8c88-418a-8134-b6a76126d218 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.743337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399a70e-8c88-418a-8134-b6a76126d218 None admin] PATH_INFO: `/v3/domains/f0bfd981b7cf4f6a83d45c4797f43fbc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.753950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399a70e-8c88-418a-8134-b6a76126d218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0bfd981b7cf4f6a83d45c4797f43fbc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:50.755392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399a70e-8c88-418a-8134-b6a76126d218 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:50.757145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 587/1172] 10.222.0.82 () {56 vars in 1183 bytes} [Mon Aug 29 18:59:50 2022] GET /identity/v3/domains/f0bfd981b7cf4f6a83d45c4797f43fbc => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:50.762965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520a2b-fcd3-4767-ae83-b365eec734ef None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:50.826743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:50.858811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7520a2b-fcd3-4767-ae83-b365eec734ef None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:50.892552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce9333-84e4-4793-b821-418ca58ed4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:50.893148 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9333-84e4-4793-b821-418ca58ed4eb None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:50.893429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9333-84e4-4793-b821-418ca58ed4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:50.893703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce9333-84e4-4793-b821-418ca58ed4eb None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:50.894356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce9333-84e4-4793-b821-418ca58ed4eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:50.895786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce9333-84e4-4793-b821-418ca58ed4eb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:50.977510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 586/1173] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 18:59:50 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:52.959366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca0e87-91f9-4bcf-bc0b-d85272e995cb None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:52.959941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca0e87-91f9-4bcf-bc0b-d85272e995cb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:52.959941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca0e87-91f9-4bcf-bc0b-d85272e995cb None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:52.961295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 588/1174] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:52.966381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae211-c0b9-4f87-8649-491e0a18e592 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:52.966808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae211-c0b9-4f87-8649-491e0a18e592 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:52.966910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae211-c0b9-4f87-8649-491e0a18e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:52.985885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-83cae211-c0b9-4f87-8649-491e0a18e592 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:52.987063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-83cae211-c0b9-4f87-8649-491e0a18e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:53.051152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 587/1175] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:53.327025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca0e87-91f9-4bcf-bc0b-d85272e995cb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.387124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:53.428169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca0e87-91f9-4bcf-bc0b-d85272e995cb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.464518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df8e02-701f-49b8-a5d6-9bda46cbdcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.465170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8e02-701f-49b8-a5d6-9bda46cbdcdb None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.465451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8e02-701f-49b8-a5d6-9bda46cbdcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.465727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df8e02-701f-49b8-a5d6-9bda46cbdcdb None admin] PATH_INFO: `/v3/domains/f0bfd981b7cf4f6a83d45c4797f43fbc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.466889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df8e02-701f-49b8-a5d6-9bda46cbdcdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=f0bfd981b7cf4f6a83d45c4797f43fbc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:53.468725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df8e02-701f-49b8-a5d6-9bda46cbdcdb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:53.470721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 589/1176] 10.222.0.82 () {56 vars in 1183 bytes} [Mon Aug 29 18:59:53 2022] GET /identity/v3/domains/f0bfd981b7cf4f6a83d45c4797f43fbc => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:53.476803 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cae211-c0b9-4f87-8649-491e0a18e592 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:53.526418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:53.576627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cae211-c0b9-4f87-8649-491e0a18e592 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:53.610641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b565ad-bc7a-4d99-8022-d7d595a47c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:53.611177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b565ad-bc7a-4d99-8022-d7d595a47c1c None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:53.611458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b565ad-bc7a-4d99-8022-d7d595a47c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:53.611756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b565ad-bc7a-4d99-8022-d7d595a47c1c None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:53.612390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b565ad-bc7a-4d99-8022-d7d595a47c1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:53.613815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b565ad-bc7a-4d99-8022-d7d595a47c1c None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:53.707799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 588/1177] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 18:59:53 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 18:59:55.668270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa343e-f48d-44c9-8b87-43476c4c3c3a None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:55.668854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa343e-f48d-44c9-8b87-43476c4c3c3a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:55.668854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa343e-f48d-44c9-8b87-43476c4c3c3a None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:55.670158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 590/1178] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:55.676064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34219-0fc5-4c76-8514-ebd417eef311 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:55.676462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34219-0fc5-4c76-8514-ebd417eef311 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:55.676625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f34219-0fc5-4c76-8514-ebd417eef311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:55.694457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a7f34219-0fc5-4c76-8514-ebd417eef311 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:55.695637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a7f34219-0fc5-4c76-8514-ebd417eef311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:55.760323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 589/1179] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 18:59:56.031684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa343e-f48d-44c9-8b87-43476c4c3c3a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:56.130487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa343e-f48d-44c9-8b87-43476c4c3c3a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:56.155996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:56.165378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c62d0-75e5-4f86-947b-41081bdc3fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:56.166003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c62d0-75e5-4f86-947b-41081bdc3fde None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.166286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c62d0-75e5-4f86-947b-41081bdc3fde None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.166569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c62d0-75e5-4f86-947b-41081bdc3fde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.176622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c62d0-75e5-4f86-947b-41081bdc3fde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-070c62d0-75e5-4f86-947b-41081bdc3fde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:56.181403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:56.182589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:56.183711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 591/1180] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:56.189282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34219-0fc5-4c76-8514-ebd417eef311 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:56.223126 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:56.287852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f34219-0fc5-4c76-8514-ebd417eef311 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:56.320707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:56.321313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.321601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.321879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.322805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:56.323115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:56.324502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:56.333085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 590/1181] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:56.338941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c62d0-75e5-4f86-947b-41081bdc3fde None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:56.437907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c62d0-75e5-4f86-947b-41081bdc3fde None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:56.472219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991312e-6e01-42e4-b6d9-aebe753cb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:56.472838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991312e-6e01-42e4-b6d9-aebe753cb1df None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.473123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991312e-6e01-42e4-b6d9-aebe753cb1df None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.473398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991312e-6e01-42e4-b6d9-aebe753cb1df None admin] PATH_INFO: `/v3/users/42023b1d24584dcf881ae9ba179899e9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.487141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991312e-6e01-42e4-b6d9-aebe753cb1df None admin] RBAC: Authorizing `identity:get_user(user_id=42023b1d24584dcf881ae9ba179899e9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:56.488612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991312e-6e01-42e4-b6d9-aebe753cb1df None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:56.490229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 592/1182] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:56 2022] GET /identity/v3/users/42023b1d24584dcf881ae9ba179899e9 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:56.496181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:56.593123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:56.599430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d52c11-6fa6-4cde-89ed-2e5a786582e4 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:56.632321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d6c3b-0748-4d87-88d0-d8b7555f72f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:56.632944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d6c3b-0748-4d87-88d0-d8b7555f72f6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.633242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d6c3b-0748-4d87-88d0-d8b7555f72f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.633588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d6c3b-0748-4d87-88d0-d8b7555f72f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.698008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d6c3b-0748-4d87-88d0-d8b7555f72f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:56.699460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d6c3b-0748-4d87-88d0-d8b7555f72f6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:56.788043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:56.794288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 591/1183] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 18:59:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 18:59:56.800522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991312e-6e01-42e4-b6d9-aebe753cb1df None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:56.846626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:56.899430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991312e-6e01-42e4-b6d9-aebe753cb1df None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:56.932252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6903f-d74b-4c16-a2ae-23716cb68f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:56.932875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6903f-d74b-4c16-a2ae-23716cb68f4b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:56.933157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6903f-d74b-4c16-a2ae-23716cb68f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:56.933431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6903f-d74b-4c16-a2ae-23716cb68f4b None admin] PATH_INFO: `/v3/projects/7e2495a994674dc197e51b656742a8fe` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:56.934544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6903f-d74b-4c16-a2ae-23716cb68f4b None admin] RBAC: Authorizing `identity:get_project(project_id=7e2495a994674dc197e51b656742a8fe)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:56.936000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6903f-d74b-4c16-a2ae-23716cb68f4b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:56.937625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 593/1184] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:56 2022] GET /identity/v3/projects/7e2495a994674dc197e51b656742a8fe => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:56.944924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d6c3b-0748-4d87-88d0-d8b7555f72f6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:57.041169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d6c3b-0748-4d87-88d0-d8b7555f72f6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:57.075320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5b672-e27b-4836-8bfe-8fdc39dcc398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:57.075954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5b672-e27b-4836-8bfe-8fdc39dcc398 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:57.076239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5b672-e27b-4836-8bfe-8fdc39dcc398 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:57.076517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5b672-e27b-4836-8bfe-8fdc39dcc398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:57.077241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5b672-e27b-4836-8bfe-8fdc39dcc398 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=7e2495a994674dc197e51b656742a8fe, user.id=42023b1d24584dcf881ae9ba179899e9) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:57.077552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5b672-e27b-4836-8bfe-8fdc39dcc398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:57.079820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5b672-e27b-4836-8bfe-8fdc39dcc398 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:57.085160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 592/1185] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 18:59:56 2022] GET /identity/v3/role_assignments?user.id=42023b1d24584dcf881ae9ba179899e9&scope.project.id=7e2495a994674dc197e51b656742a8fe&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.012057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeabb6-d133-472a-bfde-ca4ccd24751d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.012626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeabb6-d133-472a-bfde-ca4ccd24751d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.012626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edeabb6-d133-472a-bfde-ca4ccd24751d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.013957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 594/1186] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 18:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 18:59:59.019320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0737f-b2a8-4d30-95ac-5eac393cc60b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.019770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0737f-b2a8-4d30-95ac-5eac393cc60b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.019967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0737f-b2a8-4d30-95ac-5eac393cc60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.038119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a7f0737f-b2a8-4d30-95ac-5eac393cc60b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 18:59:59.039312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a7f0737f-b2a8-4d30-95ac-5eac393cc60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 18:59:59.097035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.108481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 593/1187] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 18:59:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 18:59:59.383815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeabb6-d133-472a-bfde-ca4ccd24751d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.483906 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edeabb6-d133-472a-bfde-ca4ccd24751d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.497186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.520914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df33d84-1241-4117-8a14-23512515ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.521551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df33d84-1241-4117-8a14-23512515ec19 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.521835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df33d84-1241-4117-8a14-23512515ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.522108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df33d84-1241-4117-8a14-23512515ec19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.532781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df33d84-1241-4117-8a14-23512515ec19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3df33d84-1241-4117-8a14-23512515ec19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 18:59:59.537580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 18:59:59.538733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 18:59:59.539956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 595/1188] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 18:59:59.544684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0737f-b2a8-4d30-95ac-5eac393cc60b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.642929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0737f-b2a8-4d30-95ac-5eac393cc60b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.675869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.676473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.676756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.677030 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.677691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 18:59:59.677994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.679338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.687003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 594/1189] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.693073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df33d84-1241-4117-8a14-23512515ec19 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.791473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df33d84-1241-4117-8a14-23512515ec19 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.824502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e4fcc-56d6-4b50-9566-c49eae96be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.825118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4fcc-56d6-4b50-9566-c49eae96be45 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.825402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4fcc-56d6-4b50-9566-c49eae96be45 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.825681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4fcc-56d6-4b50-9566-c49eae96be45 None admin] PATH_INFO: `/v3/users/42023b1d24584dcf881ae9ba179899e9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.826804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e4fcc-56d6-4b50-9566-c49eae96be45 None admin] RBAC: Authorizing `identity:get_user(user_id=42023b1d24584dcf881ae9ba179899e9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.828249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e4fcc-56d6-4b50-9566-c49eae96be45 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.830332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 596/1190] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/users/42023b1d24584dcf881ae9ba179899e9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.836184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 18:59:59.886826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 18:59:59.933437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc9166-7bba-46a2-b469-825466314b40 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 18:59:59.966258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861bc48-607b-4adf-ab92-bd790e400725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 18:59:59.966876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861bc48-607b-4adf-ab92-bd790e400725 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 18:59:59.967156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861bc48-607b-4adf-ab92-bd790e400725 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 18:59:59.967430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861bc48-607b-4adf-ab92-bd790e400725 None admin] PATH_INFO: `/v3/projects/7e2495a994674dc197e51b656742a8fe` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 18:59:59.968563 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861bc48-607b-4adf-ab92-bd790e400725 None admin] RBAC: Authorizing `identity:get_project(project_id=7e2495a994674dc197e51b656742a8fe)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 18:59:59.970075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861bc48-607b-4adf-ab92-bd790e400725 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 18:59:59.971669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 595/1191] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 18:59:59 2022] GET /identity/v3/projects/7e2495a994674dc197e51b656742a8fe => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 18:59:59.977661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e4fcc-56d6-4b50-9566-c49eae96be45 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:00.019990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:00.076056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e4fcc-56d6-4b50-9566-c49eae96be45 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:00.109552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9e8e5-ecc1-436b-a83b-8c7132efe21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:00.110229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9e8e5-ecc1-436b-a83b-8c7132efe21b None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:00.110506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9e8e5-ecc1-436b-a83b-8c7132efe21b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:00.110782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9e8e5-ecc1-436b-a83b-8c7132efe21b None admin] PATH_INFO: `/v3/projects/7e2495a994674dc197e51b656742a8fe/users/42023b1d24584dcf881ae9ba179899e9/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:00.112685 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9e8e5-ecc1-436b-a83b-8c7132efe21b None admin] RBAC: Authorizing `identity:create_grant(project_id=7e2495a994674dc197e51b656742a8fe, user_id=42023b1d24584dcf881ae9ba179899e9, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:00.114102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9e8e5-ecc1-436b-a83b-8c7132efe21b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:00.229617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 597/1192] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 18:59:59 2022] PUT /identity/v3/projects/7e2495a994674dc197e51b656742a8fe/users/42023b1d24584dcf881ae9ba179899e9/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:00:02.158310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc1bd-cacf-4fdc-8d34-c18d3310ce64 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.158872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc1bd-cacf-4fdc-8d34-c18d3310ce64 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.158872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bc1bd-cacf-4fdc-8d34-c18d3310ce64 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.160215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 596/1193] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:00:02.165547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d046f8-e695-4116-9520-e86b47073f5b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.165975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d046f8-e695-4116-9520-e86b47073f5b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.166093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d046f8-e695-4116-9520-e86b47073f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.184399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-50d046f8-e695-4116-9520-e86b47073f5b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:00:02.185585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-50d046f8-e695-4116-9520-e86b47073f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:00:02.253582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 598/1194] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:00:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:00:02.529274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bc1bd-cacf-4fdc-8d34-c18d3310ce64 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:02.634725 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bc1bd-cacf-4fdc-8d34-c18d3310ce64 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:02.653356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:02.666688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa9836-2bdf-4381-b77e-337f8815e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:02.667308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa9836-2bdf-4381-b77e-337f8815e07e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.667588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa9836-2bdf-4381-b77e-337f8815e07e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.679071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa9836-2bdf-4381-b77e-337f8815e07e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.679071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa9836-2bdf-4381-b77e-337f8815e07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-aaaa9836-2bdf-4381-b77e-337f8815e07e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:00:02.683224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:00:02.684345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:00:02.685321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 597/1195] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 19:00:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:00:02.691545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d046f8-e695-4116-9520-e86b47073f5b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:02.721969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:02.789816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d046f8-e695-4116-9520-e86b47073f5b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:02.824476 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:02.825076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.825357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.825698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.826507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:02.826670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:02.828060 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:02.837008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 599/1196] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 19:00:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:02.842867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa9836-2bdf-4381-b77e-337f8815e07e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:02.939591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa9836-2bdf-4381-b77e-337f8815e07e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:02.972955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c47c62-d003-47df-9b4b-b08c09f219b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:02.973574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47c62-d003-47df-9b4b-b08c09f219b0 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:02.973854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47c62-d003-47df-9b4b-b08c09f219b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:02.974128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47c62-d003-47df-9b4b-b08c09f219b0 None admin] PATH_INFO: `/v3/users/42023b1d24584dcf881ae9ba179899e9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:02.975235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c47c62-d003-47df-9b4b-b08c09f219b0 None admin] RBAC: Authorizing `identity:get_user(user_id=42023b1d24584dcf881ae9ba179899e9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:02.976731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c47c62-d003-47df-9b4b-b08c09f219b0 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:02.978279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 598/1197] 10.222.0.82 () {56 vars in 1177 bytes} [Mon Aug 29 19:00:02 2022] GET /identity/v3/users/42023b1d24584dcf881ae9ba179899e9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:02.984277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.074495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:03.083015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9222b-cb1e-49ba-ac38-5ce6a760fb5e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.116851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48f9e-6244-46e4-9573-ef71065c009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.117453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48f9e-6244-46e4-9573-ef71065c009c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.117736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48f9e-6244-46e4-9573-ef71065c009c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.118012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48f9e-6244-46e4-9573-ef71065c009c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.191329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48f9e-6244-46e4-9573-ef71065c009c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:03.192952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb48f9e-6244-46e4-9573-ef71065c009c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:03.281400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:03.291748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 600/1198] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 19:00:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:00:03.297832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c47c62-d003-47df-9b4b-b08c09f219b0 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.346923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:03.396775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c47c62-d003-47df-9b4b-b08c09f219b0 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.428772 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9aca2-ea80-4f9d-a4da-15dcbf4c2f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.429393 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9aca2-ea80-4f9d-a4da-15dcbf4c2f76 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.429676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9aca2-ea80-4f9d-a4da-15dcbf4c2f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.429951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9aca2-ea80-4f9d-a4da-15dcbf4c2f76 None admin] PATH_INFO: `/v3/projects/7e2495a994674dc197e51b656742a8fe` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.431115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9aca2-ea80-4f9d-a4da-15dcbf4c2f76 None admin] RBAC: Authorizing `identity:get_project(project_id=7e2495a994674dc197e51b656742a8fe)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:03.432501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9aca2-ea80-4f9d-a4da-15dcbf4c2f76 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:03.434109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 599/1199] 10.222.0.82 () {56 vars in 1186 bytes} [Mon Aug 29 19:00:03 2022] GET /identity/v3/projects/7e2495a994674dc197e51b656742a8fe => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:03.440888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48f9e-6244-46e4-9573-ef71065c009c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:00:03.538645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48f9e-6244-46e4-9573-ef71065c009c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:00:03.577071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29112-a1bb-4b2b-b32d-bccd1ce1c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:00:03.577669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29112-a1bb-4b2b-b32d-bccd1ce1c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:00:03.577954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29112-a1bb-4b2b-b32d-bccd1ce1c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:00:03.578230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29112-a1bb-4b2b-b32d-bccd1ce1c2f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:00:03.579033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf29112-a1bb-4b2b-b32d-bccd1ce1c2f6 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=7e2495a994674dc197e51b656742a8fe, user.id=42023b1d24584dcf881ae9ba179899e9) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:00:03.579342 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf29112-a1bb-4b2b-b32d-bccd1ce1c2f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:00:03.580788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf29112-a1bb-4b2b-b32d-bccd1ce1c2f6 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:00:03.586396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 601/1200] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 19:00:03 2022] GET /identity/v3/role_assignments?user.id=42023b1d24584dcf881ae9ba179899e9&scope.project.id=7e2495a994674dc197e51b656742a8fe&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:00:13.424663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=42 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:13.583985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=72 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:20.945361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f42a6-8959-45b9-a95b-7afd5bf52d0c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:20.945978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f42a6-8959-45b9-a95b-7afd5bf52d0c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:20.945978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f42a6-8959-45b9-a95b-7afd5bf52d0c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:20.947291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 600/1201] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:20.952728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac6b4-ecf4-48aa-adbb-46b48a9e8631 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:20.953139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac6b4-ecf4-48aa-adbb-46b48a9e8631 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:20.953286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ac6b4-ecf4-48aa-adbb-46b48a9e8631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:20.973285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ea8ac6b4-ecf4-48aa-adbb-46b48a9e8631 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:20.974495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ea8ac6b4-ecf4-48aa-adbb-46b48a9e8631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:21.046361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 602/1202] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:21.324244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f42a6-8959-45b9-a95b-7afd5bf52d0c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:21.437988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f42a6-8959-45b9-a95b-7afd5bf52d0c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:21.477538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:21.478181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:21.478458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:21.478728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:21.489911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:21.492122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:21.508429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:21.509680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:21.511079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:21.511079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:21.511079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:21.511079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 601/1203] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:21.515744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac6b4-ecf4-48aa-adbb-46b48a9e8631 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:21.623463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ac6b4-ecf4-48aa-adbb-46b48a9e8631 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:21.654372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:21.660668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98add5ef-a4bc-4996-86a9-534f415a695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:21.661281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98add5ef-a4bc-4996-86a9-534f415a695a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:21.661564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98add5ef-a4bc-4996-86a9-534f415a695a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:21.661840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98add5ef-a4bc-4996-86a9-534f415a695a None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:21.662486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98add5ef-a4bc-4996-86a9-534f415a695a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:21.662791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98add5ef-a4bc-4996-86a9-534f415a695a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:21.664285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98add5ef-a4bc-4996-86a9-534f415a695a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:21.678235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 603/1204] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:21.685263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:21.762298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:21.818113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52345727-43c6-46e9-8fbc-794f49e6d65e None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:21.852156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf08419-f6fc-47d6-9258-b41dbac34d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:21.856290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf08419-f6fc-47d6-9258-b41dbac34d87 None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:21.856290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf08419-f6fc-47d6-9258-b41dbac34d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:21.856290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf08419-f6fc-47d6-9258-b41dbac34d87 None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:21.856290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf08419-f6fc-47d6-9258-b41dbac34d87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:21.856290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf08419-f6fc-47d6-9258-b41dbac34d87 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:21.965540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 602/1205] 10.222.0.82 () {60 vars in 1132 bytes} [Mon Aug 29 19:01:21 2022] POST /identity/v3/users => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:24.172925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4bb7-6a12-4a87-9510-6bf222855b43 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:24.174021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4bb7-6a12-4a87-9510-6bf222855b43 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:24.174021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f4bb7-6a12-4a87-9510-6bf222855b43 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:24.174886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 604/1206] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:24.184452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db4e46-6a10-41aa-9541-918c7de3ddb6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:24.184941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db4e46-6a10-41aa-9541-918c7de3ddb6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:24.185046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db4e46-6a10-41aa-9541-918c7de3ddb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:24.206301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-10db4e46-6a10-41aa-9541-918c7de3ddb6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:24.208342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-10db4e46-6a10-41aa-9541-918c7de3ddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:24.295251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 603/1207] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:24.577155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f4bb7-6a12-4a87-9510-6bf222855b43 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:24.684785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f4bb7-6a12-4a87-9510-6bf222855b43 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:24.719354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cd495-9038-40bb-a5d1-ed58094af25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:24.720003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cd495-9038-40bb-a5d1-ed58094af25a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:24.720283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cd495-9038-40bb-a5d1-ed58094af25a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:24.720551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cd495-9038-40bb-a5d1-ed58094af25a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:24.730948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215cd495-9038-40bb-a5d1-ed58094af25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-215cd495-9038-40bb-a5d1-ed58094af25a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:24.735712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:24.736918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:24.738181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 605/1208] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 19:01:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:24.742950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db4e46-6a10-41aa-9541-918c7de3ddb6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:24.788899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:24.859637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db4e46-6a10-41aa-9541-918c7de3ddb6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:24.892383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:24.893006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:24.893292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:24.893587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:24.894273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:24.895163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:24.896567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:24.904317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 604/1209] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 19:01:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:24.911165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cd495-9038-40bb-a5d1-ed58094af25a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:24.963336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.010901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215cd495-9038-40bb-a5d1-ed58094af25a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.044416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.045040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.045325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.045601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.056298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.057744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:25.072111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:25.074263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:25.081728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:25.081728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:25.081728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:25.081728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 606/1210] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:25.082972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.210825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500df4f8-69c1-4fe1-a559-4b80efb717b5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.244883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.245495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.245778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.246051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.246786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:25.247105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.248538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.260975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 605/1211] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:25.266795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.370129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfad62-0d78-4de7-8839-12d6b67ee216 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.371715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.379666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.404450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674de91-f905-46f1-be02-684df68c276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.418624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674de91-f905-46f1-be02-684df68c276a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.418624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674de91-f905-46f1-be02-684df68c276a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.418624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674de91-f905-46f1-be02-684df68c276a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.418624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674de91-f905-46f1-be02-684df68c276a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.418624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674de91-f905-46f1-be02-684df68c276a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-9674de91-f905-46f1-be02-684df68c276a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:25.426607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:25.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:25.429269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:25.431881 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 607/1212] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:25.433792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.540757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e4094-acce-47e3-a385-ee984b4be927 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.578663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.579313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.579597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.579912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.580701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:25.581054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.582733 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.600118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 606/1213] 10.222.0.82 () {56 vars in 1143 bytes} [Mon Aug 29 19:01:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:25.606017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674de91-f905-46f1-be02-684df68c276a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.709165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674de91-f905-46f1-be02-684df68c276a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:25.743232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3199229-c741-4de7-8868-bc44a53ae2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:25.743869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199229-c741-4de7-8868-bc44a53ae2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:25.744151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199229-c741-4de7-8868-bc44a53ae2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:25.744425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199229-c741-4de7-8868-bc44a53ae2f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:25.773612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.810136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3199229-c741-4de7-8868-bc44a53ae2f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:25.811499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3199229-c741-4de7-8868-bc44a53ae2f9 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:25.914544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 608/1214] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:25.920623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:25.939972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:26.023437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bc665-5bb5-4f5c-8abb-a72ad7bca77b None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:26.055207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:26.055867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.056149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.056423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.067314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:26.068891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:26.083973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:26.096890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:26.097979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:26.097979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:26.097979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:26.097979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 607/1215] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:26.098289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3199229-c741-4de7-8868-bc44a53ae2f9 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:26.154394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:26.193395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3199229-c741-4de7-8868-bc44a53ae2f9 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:26.226216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:26.226830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.227117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.227394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.228234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:26.228563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:26.230031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:26.242358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 609/1216] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:26.248093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:26.319364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:26.350591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d217b-f88d-4332-b73c-02770264eafa None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:26.384441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:26.385110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.385394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.385669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.392062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:26.393484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:26.405419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:26.411169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:26.412431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 608/1217] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:26.413518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:26.515842 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f6bd2-c4ec-473e-a7ca-cc79e5bd46a7 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:26.538737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:26.550196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7f2a7-bae5-4abe-925b-f27b1d3eabd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:26.550862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7f2a7-bae5-4abe-925b-f27b1d3eabd4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.551192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7f2a7-bae5-4abe-925b-f27b1d3eabd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.551642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7f2a7-bae5-4abe-925b-f27b1d3eabd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.552363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7f2a7-bae5-4abe-925b-f27b1d3eabd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:26.552669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7f2a7-bae5-4abe-925b-f27b1d3eabd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:26.554096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7f2a7-bae5-4abe-925b-f27b1d3eabd4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:26.565392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 610/1218] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:26.572344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:26.681767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7589e-017f-4b6b-9132-5aaeadd79b6d None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:26.713326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:26.718849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63ccba-3698-40a3-abbb-c5abe43a91e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:26.719458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ccba-3698-40a3-abbb-c5abe43a91e3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:26.719806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ccba-3698-40a3-abbb-c5abe43a91e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:26.720085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ccba-3698-40a3-abbb-c5abe43a91e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:26.720809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63ccba-3698-40a3-abbb-c5abe43a91e3 None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=abf58a62bd2e4139965fc25a4f9c6161) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:26.721123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63ccba-3698-40a3-abbb-c5abe43a91e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:26.722544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63ccba-3698-40a3-abbb-c5abe43a91e3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:26.727948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 609/1219] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:26 2022] GET /identity/v3/role_assignments?user.id=abf58a62bd2e4139965fc25a4f9c6161&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:28.681398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2019-d0d7-4ad2-8186-6ebe16279115 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:28.681966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2019-d0d7-4ad2-8186-6ebe16279115 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:28.681966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2019-d0d7-4ad2-8186-6ebe16279115 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:28.683304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 611/1220] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:28.688566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967de59-2cf5-4d6e-a663-10ca58e151cb None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:28.689025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967de59-2cf5-4d6e-a663-10ca58e151cb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:28.689119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967de59-2cf5-4d6e-a663-10ca58e151cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:28.711398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a967de59-2cf5-4d6e-a663-10ca58e151cb None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:28.712665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a967de59-2cf5-4d6e-a663-10ca58e151cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:28.780344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 610/1221] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:29.064865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b2019-d0d7-4ad2-8186-6ebe16279115 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.186616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b2019-d0d7-4ad2-8186-6ebe16279115 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.229805 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76f48-fc38-4da9-ac62-20c6d9e4b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.230506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76f48-fc38-4da9-ac62-20c6d9e4b796 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.230785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76f48-fc38-4da9-ac62-20c6d9e4b796 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.231058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76f48-fc38-4da9-ac62-20c6d9e4b796 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.242009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad76f48-fc38-4da9-ac62-20c6d9e4b796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-0ad76f48-fc38-4da9-ac62-20c6d9e4b796 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:29.246902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:29.248169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:01:29.249068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:29.249893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 612/1222] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:29.256439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967de59-2cf5-4d6e-a663-10ca58e151cb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.367513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967de59-2cf5-4d6e-a663-10ca58e151cb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.392074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:29.403435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.404151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.404435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.404704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.405367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:29.405668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.407013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.416093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 611/1223] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:29.423933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76f48-fc38-4da9-ac62-20c6d9e4b796 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.471098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:29.531845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76f48-fc38-4da9-ac62-20c6d9e4b796 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.568792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.569425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.569704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.569974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.580088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.581535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:29.596545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:29.597671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:29.599244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:29.599244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:29.599244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:29.599244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 613/1224] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:29.605702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.717648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdffd55-d620-4ff0-927a-475de93f70e6 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.751641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.752206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.752485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.752755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.753461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:29.754506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.756154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.768704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 612/1225] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:29.775850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:29.893031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:29.901025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed572fb-24df-44e3-8d2c-86c4cea242e0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:29.939602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:29.940259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:29.940592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:29.940911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:29.949353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:29.951067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:29.963317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:29.967968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:29.969525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 614/1226] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:29.971967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.026450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:30.084856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cc7f29-37fd-49ef-8bff-205d8c48c0bd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.120243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.120903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.121185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.121467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.122199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:30.122507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.123978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.142383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 613/1227] 10.222.0.82 () {56 vars in 1143 bytes} [Mon Aug 29 19:01:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:30.149684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.256187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba4977-af18-40dd-bd96-b3a23a3c42e5 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.290200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.290856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.291135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.291406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.303084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.305490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:30.327528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:30.328739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:30.329878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:30.329878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:30.329878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:30.329878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 615/1228] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:30.335417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.439097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3a962-18a1-4d20-acce-2ac51bfd73cc None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.441404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:30.475519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.476174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.476505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.476782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.477428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:30.488333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.488333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.491377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 614/1229] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:30.497401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.508813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:30.603602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36ac2e-5889-4ec5-bafc-00330be97b91 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.638516 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.639118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.639394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.639664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.646187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.647614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:30.658606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:30.659677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:30.666169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 616/1230] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:30.666784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.765800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f94a-37be-44ea-9d7e-757d0cabdf24 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.799528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fec179-8adc-438a-9ca8-0f58d8f502ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.800150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec179-8adc-438a-9ca8-0f58d8f502ba None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.800431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec179-8adc-438a-9ca8-0f58d8f502ba None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.800703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fec179-8adc-438a-9ca8-0f58d8f502ba None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.801529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fec179-8adc-438a-9ca8-0f58d8f502ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:30.801821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fec179-8adc-438a-9ca8-0f58d8f502ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.803222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fec179-8adc-438a-9ca8-0f58d8f502ba None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:30.814963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 615/1231] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:30.821171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:30.889110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:30.924343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c94e76-47b7-4e61-b2b4-d1215be68dd3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:30.957813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f348198-4dd4-4afc-8c5c-4d7b1c1467eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:30.958466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f348198-4dd4-4afc-8c5c-4d7b1c1467eb None admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:30.958744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f348198-4dd4-4afc-8c5c-4d7b1c1467eb None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:30.959014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f348198-4dd4-4afc-8c5c-4d7b1c1467eb None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/abf58a62bd2e4139965fc25a4f9c6161/roles/d0a36a8f7b0a40d784c17d608a72047e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:30.974676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f348198-4dd4-4afc-8c5c-4d7b1c1467eb None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=abf58a62bd2e4139965fc25a4f9c6161, role_id=d0a36a8f7b0a40d784c17d608a72047e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:30.980214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f348198-4dd4-4afc-8c5c-4d7b1c1467eb None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:31.107394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 617/1232] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 19:01:30 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/abf58a62bd2e4139965fc25a4f9c6161/roles/d0a36a8f7b0a40d784c17d608a72047e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:01:33.049144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab089e-4835-453b-bddf-b47daf7253b1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:33.049709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab089e-4835-453b-bddf-b47daf7253b1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:33.049709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab089e-4835-453b-bddf-b47daf7253b1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:33.051547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 616/1233] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:33.056802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c04b8-fed8-4897-bed9-5300e49e8206 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:33.057219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c04b8-fed8-4897-bed9-5300e49e8206 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:33.061323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c04b8-fed8-4897-bed9-5300e49e8206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:33.076015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5d2c04b8-fed8-4897-bed9-5300e49e8206 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:33.077210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5d2c04b8-fed8-4897-bed9-5300e49e8206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:33.143006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 618/1234] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:33.414911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab089e-4835-453b-bddf-b47daf7253b1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:33.441198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:33.516274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab089e-4835-453b-bddf-b47daf7253b1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:33.550495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfd335-5631-4c20-971c-e91a40586540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:33.551881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfd335-5631-4c20-971c-e91a40586540 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:33.552151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfd335-5631-4c20-971c-e91a40586540 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:33.552421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfd335-5631-4c20-971c-e91a40586540 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:33.562282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfd335-5631-4c20-971c-e91a40586540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-cccfd335-5631-4c20-971c-e91a40586540 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:33.567307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:33.568349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:33.569626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 617/1235] 10.222.0.82 () {56 vars in 1102 bytes} [Mon Aug 29 19:01:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:33.574871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c04b8-fed8-4897-bed9-5300e49e8206 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:33.623501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:33.674519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c04b8-fed8-4897-bed9-5300e49e8206 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:33.710189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:33.710797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:33.711130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:33.711400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:33.712146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] RBAC: Adding query filter params (name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:33.712448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:33.713801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:33.721758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 619/1236] 10.222.0.82 () {56 vars in 1103 bytes} [Mon Aug 29 19:01:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:33.728769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfd335-5631-4c20-971c-e91a40586540 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:33.812065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:33.827781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfd335-5631-4c20-971c-e91a40586540 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:33.860963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:33.861586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:33.861863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:33.862133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:33.873070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:33.874508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:33.888472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:33.889600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:33.890727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:33.890727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:33.890727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:33.890727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 618/1237] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:33.896208 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:34.004943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996e27-ba37-47d4-bcc5-633e3d8a2366 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:34.013613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.040564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:34.041166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.041499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.041776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.042415 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:34.042716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:34.044100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:34.055991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 620/1238] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:34.062057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:34.164773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa204c7-4a22-4689-86ee-3916b63be056 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:34.197970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:34.198594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.198876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.199151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.202147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.207134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:34.209118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:34.220024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:34.224938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:34.226185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 619/1239] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:34.227309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:34.338119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfe1da-cdbd-4f0e-9e26-7fd42873623b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:34.372145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:34.372808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.373216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.373502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.374236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:34.374545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:34.376011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:34.394126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 621/1240] 10.222.0.82 () {56 vars in 1143 bytes} [Mon Aug 29 19:01:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:34.401664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:34.502131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83509c9-2652-4e11-ab88-f4eda77b3959 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:34.536010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e13d9-adee-40e5-be21-9545bb4cc779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:34.536608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e13d9-adee-40e5-be21-9545bb4cc779 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.536885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e13d9-adee-40e5-be21-9545bb4cc779 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.537154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e13d9-adee-40e5-be21-9545bb4cc779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.598376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.604636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e13d9-adee-40e5-be21-9545bb4cc779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:34.606075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e13d9-adee-40e5-be21-9545bb4cc779 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:34.702317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 620/1241] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:34.708246 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:34.734716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.805935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9397c2-732f-47c6-a272-4c64392b1f5a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:34.839314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:34.839966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:34.840309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:34.840749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:34.851477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:34.852921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:34.869402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:34.870582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:34.871904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:34.871904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:34.871904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:34.871904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 622/1242] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:34.876348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e13d9-adee-40e5-be21-9545bb4cc779 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:34.969754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:34.976533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e13d9-adee-40e5-be21-9545bb4cc779 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.009671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.010279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.010583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.010838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.011475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:35.011809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.013157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.024237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 621/1243] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:35.030147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.108670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:35.130280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5ec3-c3a7-442b-a74f-cea4a9f17ba3 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.167040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.167661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.167968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.168249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.174723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.176940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:35.188457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:35.189571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:35.190691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 623/1244] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:35.195812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.311354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82f1a0-5716-4b2c-ac83-21ad5d98ad53 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.345180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b042d-53d2-4170-8e9c-4e639c9df1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.345843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b042d-53d2-4170-8e9c-4e639c9df1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.346128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b042d-53d2-4170-8e9c-4e639c9df1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.346401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b042d-53d2-4170-8e9c-4e639c9df1c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.347083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b042d-53d2-4170-8e9c-4e639c9df1c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:35.347387 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b042d-53d2-4170-8e9c-4e639c9df1c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.349547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b042d-53d2-4170-8e9c-4e639c9df1c6 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.362404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 622/1245] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:35.369465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:35.481418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9dae9-dc4d-4aef-bbee-8424bfc3a06e None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:35.515022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9fcff-04c9-4391-95f6-7e2cf8cedc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:35.515627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9fcff-04c9-4391-95f6-7e2cf8cedc0c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:35.515942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9fcff-04c9-4391-95f6-7e2cf8cedc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:35.516211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9fcff-04c9-4391-95f6-7e2cf8cedc0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:35.516971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9fcff-04c9-4391-95f6-7e2cf8cedc0c None admin] RBAC: Adding query filter params (role.id=d0a36a8f7b0a40d784c17d608a72047e, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=abf58a62bd2e4139965fc25a4f9c6161) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:35.517289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9fcff-04c9-4391-95f6-7e2cf8cedc0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:35.518712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9fcff-04c9-4391-95f6-7e2cf8cedc0c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:35.525662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 624/1246] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:35 2022] GET /identity/v3/role_assignments?user.id=abf58a62bd2e4139965fc25a4f9c6161&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=d0a36a8f7b0a40d784c17d608a72047e => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:37.530627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee853a5-9a94-497e-bb88-c0c033dd8bd7 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:37.531196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee853a5-9a94-497e-bb88-c0c033dd8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:37.531196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee853a5-9a94-497e-bb88-c0c033dd8bd7 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:37.532516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 623/1247] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:37.538267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7dbe-770c-4b02-b9b1-7a37394d559b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:37.538720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7dbe-770c-4b02-b9b1-7a37394d559b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:37.538852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7dbe-770c-4b02-b9b1-7a37394d559b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:37.547436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:37.558663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-463d7dbe-770c-4b02-b9b1-7a37394d559b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:37.559897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-463d7dbe-770c-4b02-b9b1-7a37394d559b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:37.629862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 625/1248] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:37.903973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee853a5-9a94-497e-bb88-c0c033dd8bd7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:37.922010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:38.015010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee853a5-9a94-497e-bb88-c0c033dd8bd7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.049825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5e1-ff17-497b-91e5-ec78091bc2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.050460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5e1-ff17-497b-91e5-ec78091bc2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.050744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5e1-ff17-497b-91e5-ec78091bc2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.051054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5e1-ff17-497b-91e5-ec78091bc2d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.061437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a5e1-ff17-497b-91e5-ec78091bc2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-b448a5e1-ff17-497b-91e5-ec78091bc2d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:38.066358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:38.068246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:38.069378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 624/1249] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 19:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:38.074272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d7dbe-770c-4b02-b9b1-7a37394d559b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.178271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d7dbe-770c-4b02-b9b1-7a37394d559b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.208783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:38.214282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.214938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.215328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.215594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.216324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:38.216625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:38.217977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:38.226138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 626/1250] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:38.231954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5e1-ff17-497b-91e5-ec78091bc2d1 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.311388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:38.335358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5e1-ff17-497b-91e5-ec78091bc2d1 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.374633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.375269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.375545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.375848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.388196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:38.389638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:38.404757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:38.405962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:38.407073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:38.407073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:38.407073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:38.407073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 625/1251] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:38.411981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.523655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eba09a-d032-4e9b-b784-21c85a4a9285 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.559018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.559018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.560442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.560442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.560442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:38.561220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:38.561962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:38.574822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 627/1252] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:38.581072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.684194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6ad4e-c6d0-45b6-97bd-f9b5a25b64b7 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.722293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:38.730654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.731284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.731561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.732035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.740507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:38.742060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:38.753335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:38.754625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:38.755869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 626/1253] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:38.760791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:38.821358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:38.872321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd18df-699d-4a89-9a1c-d0623e32545a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:38.908903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:38.909522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:38.909806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:38.910084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:38.911361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:38.911676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:38.913126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:38.931144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 628/1254] 10.222.0.82 () {56 vars in 1143 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:38.937026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:39.051237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df9930-340e-4ac9-a61e-216d3fa01ed9 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:39.086464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9538-6344-47a8-9b9c-815a7ce706ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:39.087003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9538-6344-47a8-9b9c-815a7ce706ce None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.087287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9538-6344-47a8-9b9c-815a7ce706ce None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.087558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c9538-6344-47a8-9b9c-815a7ce706ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.151281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:39.167972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c9538-6344-47a8-9b9c-815a7ce706ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:39.169433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c9538-6344-47a8-9b9c-815a7ce706ce None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:39.291858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 627/1255] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:39.297983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:39.411819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60516c83-a5b7-4f1c-9d22-6caf8273fe00 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:39.427184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:39.451018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:39.451659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.451978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.452252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.463412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:39.464918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:39.481133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:39.489700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:39.490597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:39.490597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:39.490597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:39.490597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 629/1256] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:39.490866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9538-6344-47a8-9b9c-815a7ce706ce None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:39.582279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:39.595756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c9538-6344-47a8-9b9c-815a7ce706ce None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:39.636792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:39.637411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.637688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.637958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.638605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:39.638904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:39.640375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:39.652262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 628/1257] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:39.658214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:39.770530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f5aac-ee05-4d90-a31c-3dfd650f3724 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:39.803897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:39.804524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.804807 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.805083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.811499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:39.813079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:39.824655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:39.825994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:39.827006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 630/1258] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:39.832842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:39.934991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d57303-54bd-4c6c-be55-9752030362bd None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:39.970180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4b719-cf28-4dd4-9281-5409c09baaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:39.970792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4b719-cf28-4dd4-9281-5409c09baaea None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:39.971074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4b719-cf28-4dd4-9281-5409c09baaea None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:39.971350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4b719-cf28-4dd4-9281-5409c09baaea None admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:39.972073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4b719-cf28-4dd4-9281-5409c09baaea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:39.972381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4b719-cf28-4dd4-9281-5409c09baaea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:39.974992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4b719-cf28-4dd4-9281-5409c09baaea None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:39.987199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 629/1259] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:39.993734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:40.028390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:40.120423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d42df-3dcd-4cba-9516-a9749cc30062 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:40.157287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b02b7a-730d-4255-92a7-b734af051587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:40.157906 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02b7a-730d-4255-92a7-b734af051587 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:40.158189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02b7a-730d-4255-92a7-b734af051587 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:40.158461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b02b7a-730d-4255-92a7-b734af051587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:40.159277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b02b7a-730d-4255-92a7-b734af051587 None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=abf58a62bd2e4139965fc25a4f9c6161) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:40.159595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b02b7a-730d-4255-92a7-b734af051587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:40.161429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b02b7a-730d-4255-92a7-b734af051587 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:40.167864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 631/1260] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:39 2022] GET /identity/v3/role_assignments?user.id=abf58a62bd2e4139965fc25a4f9c6161&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:42.142039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d38ce-87bf-4b4a-a29e-32a3aba0908e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.142569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d38ce-87bf-4b4a-a29e-32a3aba0908e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.142687 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d38ce-87bf-4b4a-a29e-32a3aba0908e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.143991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 630/1261] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:42.149709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486fe3-9b43-46f6-8914-ad4621d0bd9e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.150159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486fe3-9b43-46f6-8914-ad4621d0bd9e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.150305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486fe3-9b43-46f6-8914-ad4621d0bd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.168611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-96486fe3-9b43-46f6-8914-ad4621d0bd9e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:42.169794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-96486fe3-9b43-46f6-8914-ad4621d0bd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:42.240414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 632/1262] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:42.528045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d38ce-87bf-4b4a-a29e-32a3aba0908e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:42.539597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:42.631888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d38ce-87bf-4b4a-a29e-32a3aba0908e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:42.666195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caba66-8b98-4d14-b804-b2b482aec918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:42.666820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caba66-8b98-4d14-b804-b2b482aec918 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.667102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caba66-8b98-4d14-b804-b2b482aec918 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.667377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61caba66-8b98-4d14-b804-b2b482aec918 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.677795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61caba66-8b98-4d14-b804-b2b482aec918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-61caba66-8b98-4d14-b804-b2b482aec918 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:42.682708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:42.684916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:42.686007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 631/1263] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 19:01:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:42.689947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486fe3-9b43-46f6-8914-ad4621d0bd9e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:42.708910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:42.803779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486fe3-9b43-46f6-8914-ad4621d0bd9e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:42.839182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:42.839826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:42.840107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:42.840387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:42.841059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:42.841360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:42.842744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:42.853883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 633/1264] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 19:01:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:42.859687 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caba66-8b98-4d14-b804-b2b482aec918 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:42.930659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:42.966250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61caba66-8b98-4d14-b804-b2b482aec918 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:43.000348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:43.000984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:43.001261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:43.001534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:43.012556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:43.013989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:43.029544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:43.030675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:43.032083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:43.032083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:43.032083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:43.032083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 632/1265] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:43.037128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:43.120706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:43.140313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4b09c-1cbe-47dc-8a0c-e282c8e6b8c1 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:43.176799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:43.177457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:43.177648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:43.177918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:43.178573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:43.178870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:43.180264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:43.191093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 634/1266] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:43.197766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:43.301522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bff39-7fd5-4196-8fe3-4a96f5c87d82 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:43.320926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:43.335163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:43.335821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:43.336106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:43.336381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:43.344772 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:43.346200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:43.357252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:43.360012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:43.361263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 633/1267] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:43.365027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:43.467019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410193f-e5b9-49d8-a56c-b5bbf4a3f065 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:43.500547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:43.502893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:43.503181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:43.503516 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:43.505015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:43.505539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:43.507286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:43.516547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:43.524733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 635/1268] 10.222.0.82 () {56 vars in 1143 bytes} [Mon Aug 29 19:01:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:43.531748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:43.643068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abd302-7dd3-4001-b12c-89837633b7ad None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:43.675378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:43.676688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:43.676975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:43.677430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:43.687769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:43.689219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:43.704474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:43.705621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:43.706911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:43.706911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:43.706911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:43.706911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 634/1269] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:43.711749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:43.812214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e1a27-8583-4db8-9e3c-43417345e352 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:43.850223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:43.850913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:43.851197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:43.851492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:43.852224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:43.852572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:43.854109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:43.867417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 636/1270] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:01:43.875601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:43.909346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:43.980119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be756-0a0a-4cd0-8cfe-33cc35099795 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:44.014442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:44.015066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:44.015406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:44.015683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:44.022735 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:44.024356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:44.036170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:44.042539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:44.043717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 635/1271] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 19:01:44.044382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:44.106581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:44.151988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf230-16cb-43de-ae1c-87889167bcf0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:44.197458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e667a2-4e15-4306-a345-68c23a8b33b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:44.199194 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e667a2-4e15-4306-a345-68c23a8b33b7 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:44.200072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e667a2-4e15-4306-a345-68c23a8b33b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:44.201150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e667a2-4e15-4306-a345-68c23a8b33b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:44.203212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e667a2-4e15-4306-a345-68c23a8b33b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:44.204730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e667a2-4e15-4306-a345-68c23a8b33b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:44.209490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e667a2-4e15-4306-a345-68c23a8b33b7 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:44.222506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 637/1272] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:44.229670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:44.325668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:44.334898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce45ac-ffa7-4e00-b2fb-a6fed743dc84 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:44.368863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3d452-b26b-483d-a23c-54db701e4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:44.369445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d452-b26b-483d-a23c-54db701e4e61 None admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:44.369729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d452-b26b-483d-a23c-54db701e4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:44.369999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3d452-b26b-483d-a23c-54db701e4e61 None admin] PATH_INFO: `/v3/projects/caadbe20d144460b92663c1feb48977a/users/abf58a62bd2e4139965fc25a4f9c6161/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:44.372004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d452-b26b-483d-a23c-54db701e4e61 None admin] RBAC: Authorizing `identity:create_grant(project_id=caadbe20d144460b92663c1feb48977a, user_id=abf58a62bd2e4139965fc25a4f9c6161, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:44.373455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3d452-b26b-483d-a23c-54db701e4e61 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:44.467372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 636/1273] 10.222.0.82 () {58 vars in 1439 bytes} [Mon Aug 29 19:01:44 2022] PUT /identity/v3/projects/caadbe20d144460b92663c1feb48977a/users/abf58a62bd2e4139965fc25a4f9c6161/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:01:46.465055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a637991-2296-4a52-9bd7-853e30f4a963 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:46.465556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a637991-2296-4a52-9bd7-853e30f4a963 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:46.465556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a637991-2296-4a52-9bd7-853e30f4a963 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:46.466901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 638/1274] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:46.472406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a822f-133f-426f-baad-9053ce2680d8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:46.472837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a822f-133f-426f-baad-9053ce2680d8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:46.473048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a822f-133f-426f-baad-9053ce2680d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:46.492025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f11a822f-133f-426f-baad-9053ce2680d8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:46.493285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f11a822f-133f-426f-baad-9053ce2680d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:46.572036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 637/1275] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:46.846499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a637991-2296-4a52-9bd7-853e30f4a963 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:46.954594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a637991-2296-4a52-9bd7-853e30f4a963 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:46.973296 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:46.989989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b2cf6-6d96-4813-8b41-822d12573024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:46.990614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b2cf6-6d96-4813-8b41-822d12573024 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:46.990898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b2cf6-6d96-4813-8b41-822d12573024 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:46.991173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b2cf6-6d96-4813-8b41-822d12573024 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:47.001034 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b2cf6-6d96-4813-8b41-822d12573024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-647b2cf6-6d96-4813-8b41-822d12573024 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 19:01:47.005962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:47.007043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:47.007947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 639/1276] 10.222.0.82 () {56 vars in 1096 bytes} [Mon Aug 29 19:01:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:47.013508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a822f-133f-426f-baad-9053ce2680d8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:47.095118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:47.114266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a822f-133f-426f-baad-9053ce2680d8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:47.147777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:47.148404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:47.148715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:47.148992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:47.149658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:47.150000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:47.151411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:47.159456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 638/1277] 10.222.0.82 () {56 vars in 1099 bytes} [Mon Aug 29 19:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:47.165717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b2cf6-6d96-4813-8b41-822d12573024 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:47.267840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b2cf6-6d96-4813-8b41-822d12573024 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:47.304058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:47.304692 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:47.304975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:47.305254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:47.315439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:47.317180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:47.331985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:47.333701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:47.334716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:47.334716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:47.334716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:47.334716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 640/1278] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:47.339806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:47.438916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf370d-6e71-4ebd-be38-a050eba18654 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:47.472552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:47.473882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:47.474147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:47.474697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:47.475090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:47.475397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:47.476852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:47.488325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 639/1279] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:47.494424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:47.526814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:47.598415 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b698ffe-b39b-4403-bfce-92620167ee1c None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:47.632529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:47.633149 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:47.633433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:47.633704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:47.640478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:47.641896 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 19:01:47.653768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:47.654812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:47.655935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 641/1280] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:47.661087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:47.665006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:47.760423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4f45-c462-4a40-890b-14a2ee9b8bf3 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:47.794536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:47.795145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:47.795428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:47.795702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:47.796577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:47.796891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:47.798299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:47.815464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 640/1281] 10.222.0.82 () {56 vars in 1143 bytes} [Mon Aug 29 19:01:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:47.822005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:47.927848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:47.937616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a29373-36ff-4cbb-a26d-fc5399367ee0 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:47.980998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544e61d-f22d-47d0-95ae-a4c93d77f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:47.981634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e61d-f22d-47d0-95ae-a4c93d77f57d None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:47.981891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e61d-f22d-47d0-95ae-a4c93d77f57d None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:47.982163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e61d-f22d-47d0-95ae-a4c93d77f57d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.058138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544e61d-f22d-47d0-95ae-a4c93d77f57d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.059501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544e61d-f22d-47d0-95ae-a4c93d77f57d None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.149547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:48.159633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 642/1282] 10.222.0.82 () {58 vars in 1282 bytes} [Mon Aug 29 19:01:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:48.166001 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:48.229819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:48.268318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e266215-2919-4ca2-a9e3-3ff078b6d8fb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:48.304582 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:48.305220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:48.305634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:48.305917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.315897 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.317422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 19:01:48.332254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:48.346343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 19:01:48.347452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 19:01:48.347452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 19:01:48.347452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:48.347452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 641/1283] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:48.347690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544e61d-f22d-47d0-95ae-a4c93d77f57d None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:48.441645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544e61d-f22d-47d0-95ae-a4c93d77f57d None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:48.477723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:48.478336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:48.478634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:48.478900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.479538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:48.479885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.481245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.493172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 643/1284] 10.222.0.82 () {56 vars in 1109 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:48.499069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:48.610503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683adaf1-3e6a-459d-ab30-b76afa8b89fb None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:48.624346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:48.644131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:48.644999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:48.645243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:48.645522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.652505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.654076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 19:01:48.667956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:48.672769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:01:48.673908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 642/1285] 10.222.0.82 () {56 vars in 1111 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:48.677273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:48.727713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:48.782828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9c1b4-e513-454a-a487-0eb8c31e5794 None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:48.817645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f364e5-12f9-4453-ac5f-a2db0aa5fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:48.818266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f364e5-12f9-4453-ac5f-a2db0aa5fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:48.818589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f364e5-12f9-4453-ac5f-a2db0aa5fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:48.818863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f364e5-12f9-4453-ac5f-a2db0aa5fdd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.819557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f364e5-12f9-4453-ac5f-a2db0aa5fdd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:48.819899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f364e5-12f9-4453-ac5f-a2db0aa5fdd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.821309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f364e5-12f9-4453-ac5f-a2db0aa5fdd5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.834349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 644/1286] 10.222.0.82 () {56 vars in 1148 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:48.840763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:48.945628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ae3ae-673a-4d98-a248-831324c206e5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:48.980978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18688df7-c8b2-4f0a-8796-64f0c9f4aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:48.981571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18688df7-c8b2-4f0a-8796-64f0c9f4aeaf None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:48.981847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18688df7-c8b2-4f0a-8796-64f0c9f4aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:48.982115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18688df7-c8b2-4f0a-8796-64f0c9f4aeaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:48.982812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18688df7-c8b2-4f0a-8796-64f0c9f4aeaf None admin] RBAC: Adding query filter params (role.id=3925fcafb9614006a2cfc4cee7429b52, scope.project.id=caadbe20d144460b92663c1feb48977a, user.id=abf58a62bd2e4139965fc25a4f9c6161) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:48.983112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18688df7-c8b2-4f0a-8796-64f0c9f4aeaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:48.984540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18688df7-c8b2-4f0a-8796-64f0c9f4aeaf None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:48.990392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 643/1287] 10.222.0.82 () {56 vars in 1374 bytes} [Mon Aug 29 19:01:48 2022] GET /identity/v3/role_assignments?user.id=abf58a62bd2e4139965fc25a4f9c6161&scope.project.id=caadbe20d144460b92663c1feb48977a&role.id=3925fcafb9614006a2cfc4cee7429b52 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:50.995550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5268f2-c03a-45da-87f1-9c2a8ff26a83 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:50.996117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5268f2-c03a-45da-87f1-9c2a8ff26a83 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:50.996117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5268f2-c03a-45da-87f1-9c2a8ff26a83 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:50.997529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 645/1288] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:01:51.002830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ee6c7-b67d-44ae-a86f-4e474e8be189 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:51.003253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ee6c7-b67d-44ae-a86f-4e474e8be189 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:51.004830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ee6c7-b67d-44ae-a86f-4e474e8be189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:51.021973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-640ee6c7-b67d-44ae-a86f-4e474e8be189 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:51.023182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-640ee6c7-b67d-44ae-a86f-4e474e8be189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:51.055881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:51.092241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 644/1289] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:51.359619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5268f2-c03a-45da-87f1-9c2a8ff26a83 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:51.467733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5268f2-c03a-45da-87f1-9c2a8ff26a83 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:51.479597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:51.503152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:51.503835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:51.504263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:51.504787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:51.505354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:51.506800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:51.515836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:51.517000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:51.518118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 646/1290] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 19:01:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:51.523852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ee6c7-b67d-44ae-a86f-4e474e8be189 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:51.626046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ee6c7-b67d-44ae-a86f-4e474e8be189 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:51.667501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b559324-fc6c-457c-aee3-14883dc63162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:51.668197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559324-fc6c-457c-aee3-14883dc63162 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:51.668465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559324-fc6c-457c-aee3-14883dc63162 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:51.668738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559324-fc6c-457c-aee3-14883dc63162 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:51.669409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b559324-fc6c-457c-aee3-14883dc63162 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:51.669716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b559324-fc6c-457c-aee3-14883dc63162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:51.671154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b559324-fc6c-457c-aee3-14883dc63162 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:51.677984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 645/1291] 10.222.0.82 () {56 vars in 1116 bytes} [Mon Aug 29 19:01:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:51.683852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:51.790977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5bc51-faf3-4b9d-b04e-11b5e72f700b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:51.823773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0027ef-3676-4460-9b13-d8452cc6a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:51.824378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0027ef-3676-4460-9b13-d8452cc6a466 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:51.824661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0027ef-3676-4460-9b13-d8452cc6a466 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:51.824935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0027ef-3676-4460-9b13-d8452cc6a466 None admin] PATH_INFO: `/v3/services` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:51.825567 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0027ef-3676-4460-9b13-d8452cc6a466 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:51.825874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0027ef-3676-4460-9b13-d8452cc6a466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:51.827503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0027ef-3676-4460-9b13-d8452cc6a466 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:51.831903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 647/1292] 10.222.0.82 () {56 vars in 1116 bytes} [Mon Aug 29 19:01:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:53.797600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6c43-08ae-43f6-b0d5-6b13f4ccf6b1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:53.798195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6c43-08ae-43f6-b0d5-6b13f4ccf6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:53.798195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f6c43-08ae-43f6-b0d5-6b13f4ccf6b1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:53.799468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 646/1293] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:53.805627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804665-a594-4c2d-98b0-9dd3e2d3b25d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:53.806082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804665-a594-4c2d-98b0-9dd3e2d3b25d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:53.806181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804665-a594-4c2d-98b0-9dd3e2d3b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:53.825585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-75804665-a594-4c2d-98b0-9dd3e2d3b25d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:53.827036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-75804665-a594-4c2d-98b0-9dd3e2d3b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:53.857806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:53.896092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 648/1294] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 19:01:54.172347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f6c43-08ae-43f6-b0d5-6b13f4ccf6b1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:54.204448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:54.275331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f6c43-08ae-43f6-b0d5-6b13f4ccf6b1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:54.310640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac23dd-b6d7-4aa0-9fa3-20e7a6cc056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:54.313184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac23dd-b6d7-4aa0-9fa3-20e7a6cc056f None admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:54.313184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac23dd-b6d7-4aa0-9fa3-20e7a6cc056f None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:54.313184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac23dd-b6d7-4aa0-9fa3-20e7a6cc056f None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:54.313184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac23dd-b6d7-4aa0-9fa3-20e7a6cc056f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:54.313816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac23dd-b6d7-4aa0-9fa3-20e7a6cc056f None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:54.404883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 647/1295] 10.222.0.82 () {60 vars in 1141 bytes} [Mon Aug 29 19:01:54 2022] POST /identity/v3/services => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:01:56.401182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02631-b68a-4214-80f7-64e6dcbd0c95 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:56.401749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02631-b68a-4214-80f7-64e6dcbd0c95 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:56.401749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b02631-b68a-4214-80f7-64e6dcbd0c95 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:56.403066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 649/1296] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:56.408594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020f4d-cada-4c20-8953-c0eb353b21a6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:56.412464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020f4d-cada-4c20-8953-c0eb353b21a6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:56.412464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34020f4d-cada-4c20-8953-c0eb353b21a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:56.428922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-34020f4d-cada-4c20-8953-c0eb353b21a6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:56.430292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-34020f4d-cada-4c20-8953-c0eb353b21a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:56.505212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 648/1297] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:56 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:56.799978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02631-b68a-4214-80f7-64e6dcbd0c95 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:56.906191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b02631-b68a-4214-80f7-64e6dcbd0c95 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:56.941709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:56.942338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:56.942619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:56.942922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:56.943509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:56.944930 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:56.954426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:56.955689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:56.956703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 650/1298] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 19:01:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:01:56.963981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34020f4d-cada-4c20-8953-c0eb353b21a6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:56.983281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:57.078174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34020f4d-cada-4c20-8953-c0eb353b21a6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:57.114027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:57.114626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:57.114904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:57.115356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:57.115886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:57.116193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:57.117547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:57.122674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 649/1299] 10.222.0.82 () {56 vars in 1116 bytes} [Mon Aug 29 19:01:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:57.128810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:57.166907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:57.239945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb83cc-410e-4d78-8e2e-8bba6369243a None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:57.275921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8680aa2-d0ea-4b3d-bd39-a2b9e3b6f9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:57.276661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680aa2-d0ea-4b3d-bd39-a2b9e3b6f9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:57.277057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680aa2-d0ea-4b3d-bd39-a2b9e3b6f9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:57.277441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8680aa2-d0ea-4b3d-bd39-a2b9e3b6f9a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:57.278240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8680aa2-d0ea-4b3d-bd39-a2b9e3b6f9a4 None admin] RBAC: Adding query filter params (interface=public, service_id=b60e10d021e04af897728688bcf0e620, region_id=RegionOne) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:01:57.278594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8680aa2-d0ea-4b3d-bd39-a2b9e3b6f9a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:57.280079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8680aa2-d0ea-4b3d-bd39-a2b9e3b6f9a4 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:57.286296 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 651/1300] 10.222.0.82 () {56 vars in 1251 bytes} [Mon Aug 29 19:01:57 2022] GET /identity/v3/endpoints?service_id=b60e10d021e04af897728688bcf0e620&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:01:57.292080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:57.381224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:57.400474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9849c-5c27-40a6-865a-fc541d327cf5 None admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:57.435054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc2ce7-1fdb-43a9-9075-920fc9cb4f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:57.435977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc2ce7-1fdb-43a9-9075-920fc9cb4f2b None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:57.435977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc2ce7-1fdb-43a9-9075-920fc9cb4f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:57.436255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc2ce7-1fdb-43a9-9075-920fc9cb4f2b None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:57.436831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc2ce7-1fdb-43a9-9075-920fc9cb4f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:57.438217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc2ce7-1fdb-43a9-9075-920fc9cb4f2b None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:57.445848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 650/1301] 10.222.0.82 () {56 vars in 1087 bytes} [Mon Aug 29 19:01:57 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:01:59.429572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d471-9f8f-461c-834f-7981fcc434aa None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:59.430121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d471-9f8f-461c-834f-7981fcc434aa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:59.430231 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d471-9f8f-461c-834f-7981fcc434aa None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:59.431603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 652/1302] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:01:59.437384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e8d7a-5603-441d-9341-673069e61bd5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:59.437825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e8d7a-5603-441d-9341-673069e61bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:59.437925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e8d7a-5603-441d-9341-673069e61bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:59.456957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-702e8d7a-5603-441d-9341-673069e61bd5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:01:59.458720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-702e8d7a-5603-441d-9341-673069e61bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:01:59.536177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 651/1303] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:01:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 19:01:59.823165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9d471-9f8f-461c-834f-7981fcc434aa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:01:59.937890 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:59.946932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9d471-9f8f-461c-834f-7981fcc434aa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:01:59.983039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:01:59.983699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:01:59.984038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:01:59.984362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:01:59.984994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:01:59.986466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:01:59.996980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 19:01:59.998252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application with Lock( Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self._enter() Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.creator() Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application created_value = creator( Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:01:59.999319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 653/1304] 10.222.0.82 () {56 vars in 1117 bytes} [Mon Aug 29 19:01:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 19:02:00.005778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e8d7a-5603-441d-9341-673069e61bd5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:00.105599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:00.132571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e8d7a-5603-441d-9341-673069e61bd5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:00.170275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d3baa-1642-459c-b1cd-029def5dc046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:00.170891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3baa-1642-459c-b1cd-029def5dc046 None admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:00.171170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3baa-1642-459c-b1cd-029def5dc046 None admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:00.171449 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d3baa-1642-459c-b1cd-029def5dc046 None admin] PATH_INFO: `/v3/services` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:00.172104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d3baa-1642-459c-b1cd-029def5dc046 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:02:00.172420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d3baa-1642-459c-b1cd-029def5dc046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:00.173837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d3baa-1642-459c-b1cd-029def5dc046 None admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:00.180026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 652/1305] 10.222.0.82 () {56 vars in 1116 bytes} [Mon Aug 29 19:02:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:02:00.186250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:02:00.301962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96eb66-4b3d-4a81-ac16-f6a23ba0ce5b None admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:02:00.338385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44790a8-667f-4142-bbc3-e8954a843df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:02:00.338985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44790a8-667f-4142-bbc3-e8954a843df5 None admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:02:00.339265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44790a8-667f-4142-bbc3-e8954a843df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:02:00.339538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44790a8-667f-4142-bbc3-e8954a843df5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:02:00.340316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44790a8-667f-4142-bbc3-e8954a843df5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:02:00.341718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44790a8-667f-4142-bbc3-e8954a843df5 None admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:02:00.431334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 654/1306] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:02:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:02:10.238867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=30 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:10.424544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:56.575151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc93698-8c06-414c-bf5b-d182cc9ffb87 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:08:56.575746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc93698-8c06-414c-bf5b-d182cc9ffb87 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:08:56.575746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc93698-8c06-414c-bf5b-d182cc9ffb87 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:08:56.577251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 653/1307] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:08:56.584263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f640da-ce8e-4c38-b27e-7afda3830446 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:08:56.585491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f640da-ce8e-4c38-b27e-7afda3830446 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:08:56.586047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f640da-ce8e-4c38-b27e-7afda3830446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:08:56.690479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-93f640da-ce8e-4c38-b27e-7afda3830446 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:08:56.692186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-93f640da-ce8e-4c38-b27e-7afda3830446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:08:56.937876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 655/1308] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:08:57.232391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e983b6-44d5-4073-9b8d-1197d0456348 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:08:57.232748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e983b6-44d5-4073-9b8d-1197d0456348 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:08:57.233100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e983b6-44d5-4073-9b8d-1197d0456348 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:08:57.234526 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 654/1309] 10.222.0.82 () {54 vars in 965 bytes} [Mon Aug 29 19:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:08:57.241493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156ff53-feec-4485-a638-9bc81692af3c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:08:57.243082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156ff53-feec-4485-a638-9bc81692af3c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:08:57.243082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156ff53-feec-4485-a638-9bc81692af3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:08:57.331570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f156ff53-feec-4485-a638-9bc81692af3c None None] MFA Rules not processed for user `218e551387574808b225e73b766b5062`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:08:57.332849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f156ff53-feec-4485-a638-9bc81692af3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:08:57.361365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:57.437430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 656/1310] 10.222.0.82 () {58 vars in 1062 bytes} [Mon Aug 29 19:08:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:08:57.447095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e983b6-44d5-4073-9b8d-1197d0456348 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:08:57.448996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-21e983b6-44d5-4073-9b8d-1197d0456348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:08:57.587037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e983b6-44d5-4073-9b8d-1197d0456348 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:08:57.671041 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d357997-f91c-478a-84cb-e6c5073b249a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:08:57.671998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357997-f91c-478a-84cb-e6c5073b249a service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:08:57.672435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357997-f91c-478a-84cb-e6c5073b249a service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:08:57.672925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d357997-f91c-478a-84cb-e6c5073b249a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:08:57.674691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6d357997-f91c-478a-84cb-e6c5073b249a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:08:57.749629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:57.820035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d357997-f91c-478a-84cb-e6c5073b249a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:08:57.822178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d357997-f91c-478a-84cb-e6c5073b249a service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:08:57.847717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 655/1311] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:00.165900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ca64-6f3e-4800-afed-cf8f071206c8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:00.166448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ca64-6f3e-4800-afed-cf8f071206c8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:00.166448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ca64-6f3e-4800-afed-cf8f071206c8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:00.167872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 657/1312] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:00.173676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5dee0-040e-41d3-8ddb-6c08e9d5fffa None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:00.174172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5dee0-040e-41d3-8ddb-6c08e9d5fffa None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:00.174318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5dee0-040e-41d3-8ddb-6c08e9d5fffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:00.261426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8fc5dee0-040e-41d3-8ddb-6c08e9d5fffa None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:00.262654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8fc5dee0-040e-41d3-8ddb-6c08e9d5fffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:00.375698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 656/1313] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:00.678569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4eae-1777-4187-bc6f-a37e9b25593e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:00.678850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4eae-1777-4187-bc6f-a37e9b25593e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:00.679126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a4eae-1777-4187-bc6f-a37e9b25593e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:00.680522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 658/1314] 10.222.0.82 () {54 vars in 965 bytes} [Mon Aug 29 19:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:00.686425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a8bc-9633-453c-9499-746669eca694 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:00.686722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a8bc-9633-453c-9499-746669eca694 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:00.687004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a8bc-9633-453c-9499-746669eca694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:00.699559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:00.763382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fca9a8bc-9633-453c-9499-746669eca694 None None] MFA Rules not processed for user `218e551387574808b225e73b766b5062`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:00.764626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fca9a8bc-9633-453c-9499-746669eca694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:00.839501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 657/1315] 10.222.0.82 () {58 vars in 1062 bytes} [Mon Aug 29 19:09:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:00.848778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a4eae-1777-4187-bc6f-a37e9b25593e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:00.850458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-214a4eae-1777-4187-bc6f-a37e9b25593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:00.955118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a4eae-1777-4187-bc6f-a37e9b25593e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:01.026349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:01.028843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6db3d-36a9-4024-a4df-98ef7b67b2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:01.029436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6db3d-36a9-4024-a4df-98ef7b67b2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:01.029713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6db3d-36a9-4024-a4df-98ef7b67b2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:01.029982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6db3d-36a9-4024-a4df-98ef7b67b2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:01.031554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4bf6db3d-36a9-4024-a4df-98ef7b67b2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:01.138675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6db3d-36a9-4024-a4df-98ef7b67b2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:01.140203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6db3d-36a9-4024-a4df-98ef7b67b2b5 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:01.158420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 659/1316] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:03.809079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f008-211c-422d-8959-532b640f66f5 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:03.809617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f008-211c-422d-8959-532b640f66f5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:03.809617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9f008-211c-422d-8959-532b640f66f5 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:03.810955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 658/1317] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:03.816110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af4917-6ec3-4002-b7d1-2ece92760ef0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:03.816521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af4917-6ec3-4002-b7d1-2ece92760ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:03.816650 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af4917-6ec3-4002-b7d1-2ece92760ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:03.883755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-61af4917-6ec3-4002-b7d1-2ece92760ef0 None None] MFA Rules not processed for user `00371932fc0e4504a658ef41b1609571`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:03.885026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-61af4917-6ec3-4002-b7d1-2ece92760ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:03.936942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:03.982226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 660/1318] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:04.267860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9f008-211c-422d-8959-532b640f66f5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:04.269452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f4d9f008-211c-422d-8959-532b640f66f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:04.376300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9f008-211c-422d-8959-532b640f66f5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:04.379190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:04.449380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a4904-15ec-4e28-b472-7b9508124abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:04.449986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a4904-15ec-4e28-b472-7b9508124abd service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:04.450265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a4904-15ec-4e28-b472-7b9508124abd service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:04.450537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a4904-15ec-4e28-b472-7b9508124abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:04.452153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4a3a4904-15ec-4e28-b472-7b9508124abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:04.558459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a4904-15ec-4e28-b472-7b9508124abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:04.559926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a4904-15ec-4e28-b472-7b9508124abd service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:04.577607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 659/1319] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:04 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:07.576176 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d4ac-6e91-44e9-ab66-e8be3e1601c1 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:07.576724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d4ac-6e91-44e9-ab66-e8be3e1601c1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:07.576724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7d4ac-6e91-44e9-ab66-e8be3e1601c1 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:07.578090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 661/1320] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:07.584001 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2483e-7c0a-401d-a8b3-33c466e69086 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:07.584538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2483e-7c0a-401d-a8b3-33c466e69086 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:07.584538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2483e-7c0a-401d-a8b3-33c466e69086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:07.633412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:07.660385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-27d2483e-7c0a-401d-a8b3-33c466e69086 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:07.662436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-27d2483e-7c0a-401d-a8b3-33c466e69086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:07.761136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 660/1321] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:08.053157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7d4ac-6e91-44e9-ab66-e8be3e1601c1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:08.054694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a1f7d4ac-6e91-44e9-ab66-e8be3e1601c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:08.159288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7d4ac-6e91-44e9-ab66-e8be3e1601c1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:08.235403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b7610-1072-4b25-8a34-fb6391c1357e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:08.236029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7610-1072-4b25-8a34-fb6391c1357e service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:08.236314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7610-1072-4b25-8a34-fb6391c1357e service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:08.236590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7610-1072-4b25-8a34-fb6391c1357e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:08.238177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-434b7610-1072-4b25-8a34-fb6391c1357e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:08.245741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:08.347533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b7610-1072-4b25-8a34-fb6391c1357e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:08.349549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b7610-1072-4b25-8a34-fb6391c1357e service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:08.368432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 662/1322] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:11.326309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4f2d-8af9-444e-81f6-fde76d6ecf14 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:11.326871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4f2d-8af9-444e-81f6-fde76d6ecf14 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:11.326871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a4f2d-8af9-444e-81f6-fde76d6ecf14 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:11.328382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 661/1323] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:11.334315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d4d5-cb4c-4c73-b13b-7891d2f76f0a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:11.334756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d4d5-cb4c-4c73-b13b-7891d2f76f0a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:11.334910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d4d5-cb4c-4c73-b13b-7891d2f76f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:11.403227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4059d4d5-cb4c-4c73-b13b-7891d2f76f0a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:11.404485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4059d4d5-cb4c-4c73-b13b-7891d2f76f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:11.463540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:11.504745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 663/1324] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:11.790527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a4f2d-8af9-444e-81f6-fde76d6ecf14 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:11.792123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fd7a4f2d-8af9-444e-81f6-fde76d6ecf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:11.921233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a4f2d-8af9-444e-81f6-fde76d6ecf14 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:11.938651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:12.010485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624005e-782c-476e-a1b1-1f95f153e97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:12.011103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624005e-782c-476e-a1b1-1f95f153e97f service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:12.011412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624005e-782c-476e-a1b1-1f95f153e97f service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:12.011765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624005e-782c-476e-a1b1-1f95f153e97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:12.013357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a624005e-782c-476e-a1b1-1f95f153e97f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:12.138005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624005e-782c-476e-a1b1-1f95f153e97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:12.139352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624005e-782c-476e-a1b1-1f95f153e97f service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:12.159484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 662/1325] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:14.236615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0d012-a0e6-486b-992a-c9459f7e3506 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:14.237173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0d012-a0e6-486b-992a-c9459f7e3506 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:14.237173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0d012-a0e6-486b-992a-c9459f7e3506 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:14.238524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 664/1326] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:14.245100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec684b41-b780-4974-aad5-7d7a38c444a2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:14.245544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec684b41-b780-4974-aad5-7d7a38c444a2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:14.245666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec684b41-b780-4974-aad5-7d7a38c444a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:14.294747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:14.313457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ec684b41-b780-4974-aad5-7d7a38c444a2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:14.314613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ec684b41-b780-4974-aad5-7d7a38c444a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:14.414641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 663/1327] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:14.701953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0d012-a0e6-486b-992a-c9459f7e3506 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:14.703568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cfd0d012-a0e6-486b-992a-c9459f7e3506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:14.814768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0d012-a0e6-486b-992a-c9459f7e3506 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:14.893603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe50dcd-80f1-45c3-bf49-f4ba4aca4e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:14.894267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe50dcd-80f1-45c3-bf49-f4ba4aca4e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:14.894550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe50dcd-80f1-45c3-bf49-f4ba4aca4e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:14.894827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe50dcd-80f1-45c3-bf49-f4ba4aca4e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:14.896557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dfe50dcd-80f1-45c3-bf49-f4ba4aca4e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:14.915107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:15.019393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe50dcd-80f1-45c3-bf49-f4ba4aca4e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:15.020935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe50dcd-80f1-45c3-bf49-f4ba4aca4e95 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:15.042125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 665/1328] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:17.069442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6a62-174e-43f9-9b78-256b818098fe None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:17.070005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6a62-174e-43f9-9b78-256b818098fe None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:17.070005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b6a62-174e-43f9-9b78-256b818098fe None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:17.071466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 664/1329] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:17.076803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8201760-d6e4-4a18-a80c-fda0f67869f5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:17.077243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8201760-d6e4-4a18-a80c-fda0f67869f5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:17.077402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8201760-d6e4-4a18-a80c-fda0f67869f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:17.151632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b8201760-d6e4-4a18-a80c-fda0f67869f5 None None] MFA Rules not processed for user `00371932fc0e4504a658ef41b1609571`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:17.152900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b8201760-d6e4-4a18-a80c-fda0f67869f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:17.226317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:17.261555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 666/1330] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:17.546504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6a62-174e-43f9-9b78-256b818098fe None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:17.548045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-736b6a62-174e-43f9-9b78-256b818098fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:17.684612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b6a62-174e-43f9-9b78-256b818098fe None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:17.706891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:17.771573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33675291-6084-4b30-b1a6-bffa9b2ef072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:17.772235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675291-6084-4b30-b1a6-bffa9b2ef072 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:17.772521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675291-6084-4b30-b1a6-bffa9b2ef072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:17.772791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33675291-6084-4b30-b1a6-bffa9b2ef072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:17.774417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-33675291-6084-4b30-b1a6-bffa9b2ef072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:17.899090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33675291-6084-4b30-b1a6-bffa9b2ef072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:17.900481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33675291-6084-4b30-b1a6-bffa9b2ef072 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:17.919300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 665/1331] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:20.326558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457490-2623-415f-9e01-1bccc4909445 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:20.327065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457490-2623-415f-9e01-1bccc4909445 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:20.327154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2457490-2623-415f-9e01-1bccc4909445 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:20.328554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 667/1332] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:20.334634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4a37-f3e0-46c0-89a0-4d6bac70c522 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:20.335084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4a37-f3e0-46c0-89a0-4d6bac70c522 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:20.335187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4a37-f3e0-46c0-89a0-4d6bac70c522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:20.398863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:20.401560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b01a4a37-f3e0-46c0-89a0-4d6bac70c522 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:20.402787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b01a4a37-f3e0-46c0-89a0-4d6bac70c522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:20.511149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 666/1333] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:20.799572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2457490-2623-415f-9e01-1bccc4909445 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:20.801173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f2457490-2623-415f-9e01-1bccc4909445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:20.907072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2457490-2623-415f-9e01-1bccc4909445 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:20.982385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78e57e-8dff-46ab-b7ec-4e370ead7e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:20.982996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78e57e-8dff-46ab-b7ec-4e370ead7e08 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:20.983279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78e57e-8dff-46ab-b7ec-4e370ead7e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:20.983552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78e57e-8dff-46ab-b7ec-4e370ead7e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:20.985182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9f78e57e-8dff-46ab-b7ec-4e370ead7e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:21.012785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:21.099100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78e57e-8dff-46ab-b7ec-4e370ead7e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:21.100473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78e57e-8dff-46ab-b7ec-4e370ead7e08 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:21.118667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 668/1334] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:23.119719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5fb0-7c78-4c91-8253-bce42cf6e664 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:23.120319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5fb0-7c78-4c91-8253-bce42cf6e664 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:23.120319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb5fb0-7c78-4c91-8253-bce42cf6e664 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:23.121625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 667/1335] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:23.127005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539c2f-c011-464b-b6bb-30288c9d051c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:23.127449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539c2f-c011-464b-b6bb-30288c9d051c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:23.127549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12539c2f-c011-464b-b6bb-30288c9d051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:23.194950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-12539c2f-c011-464b-b6bb-30288c9d051c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:23.196202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-12539c2f-c011-464b-b6bb-30288c9d051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:23.275414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:23.297912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 669/1336] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:23.601748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5fb0-7c78-4c91-8253-bce42cf6e664 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:23.603299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7ecb5fb0-7c78-4c91-8253-bce42cf6e664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:23.713490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb5fb0-7c78-4c91-8253-bce42cf6e664 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:23.742252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:23.788961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40fad1-bb87-454c-9769-f89fd6bd6535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:23.789570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40fad1-bb87-454c-9769-f89fd6bd6535 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:23.789883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40fad1-bb87-454c-9769-f89fd6bd6535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:23.790158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40fad1-bb87-454c-9769-f89fd6bd6535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:23.791788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8c40fad1-bb87-454c-9769-f89fd6bd6535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:23.902904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40fad1-bb87-454c-9769-f89fd6bd6535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:23.904289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40fad1-bb87-454c-9769-f89fd6bd6535 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:23.922482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 668/1337] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:26.618463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cd21a-328e-4754-99a6-42b422390286 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:26.619110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cd21a-328e-4754-99a6-42b422390286 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:26.619110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cd21a-328e-4754-99a6-42b422390286 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:26.620417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 670/1338] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:26.625896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943f29-0a92-432c-b2dd-78d4507f870c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:26.626338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943f29-0a92-432c-b2dd-78d4507f870c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:26.626517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943f29-0a92-432c-b2dd-78d4507f870c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:26.698894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c2943f29-0a92-432c-b2dd-78d4507f870c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:26.700133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c2943f29-0a92-432c-b2dd-78d4507f870c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:26.710035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:26.797995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 669/1339] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:27.098345 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cd21a-328e-4754-99a6-42b422390286 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:27.099909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f96cd21a-328e-4754-99a6-42b422390286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:27.225443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cd21a-328e-4754-99a6-42b422390286 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:27.300530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d69d0-e1cf-4ee5-97a2-4206b88548c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:27.301670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d69d0-e1cf-4ee5-97a2-4206b88548c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:27.302001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d69d0-e1cf-4ee5-97a2-4206b88548c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:27.302278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d69d0-e1cf-4ee5-97a2-4206b88548c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:27.303913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2d0d69d0-e1cf-4ee5-97a2-4206b88548c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:27.343272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:27.420964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d69d0-e1cf-4ee5-97a2-4206b88548c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:27.422569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d69d0-e1cf-4ee5-97a2-4206b88548c9 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:27.443785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 671/1340] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:09:31.937786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459217f-a0d6-4ff2-9a1f-f3627f2ece2b None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:31.938814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459217f-a0d6-4ff2-9a1f-f3627f2ece2b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:31.938814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459217f-a0d6-4ff2-9a1f-f3627f2ece2b None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:31.939904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 670/1341] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:31.947898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59cd6e-c200-4692-8e7c-d54e998b055d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:31.948468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59cd6e-c200-4692-8e7c-d54e998b055d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:31.948468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59cd6e-c200-4692-8e7c-d54e998b055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:32.032577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7d59cd6e-c200-4692-8e7c-d54e998b055d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:32.034550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7d59cd6e-c200-4692-8e7c-d54e998b055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:32.140813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:32.156281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 672/1342] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:32.483669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459217f-a0d6-4ff2-9a1f-f3627f2ece2b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:32.485285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8459217f-a0d6-4ff2-9a1f-f3627f2ece2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:32.608469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459217f-a0d6-4ff2-9a1f-f3627f2ece2b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:32.674589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:32.719466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d02422-90da-4f72-a3d0-15bb38e61318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:32.720505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d02422-90da-4f72-a3d0-15bb38e61318 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:32.721210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d02422-90da-4f72-a3d0-15bb38e61318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:32.721627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d02422-90da-4f72-a3d0-15bb38e61318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:32.725688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-82d02422-90da-4f72-a3d0-15bb38e61318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:32.870489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d02422-90da-4f72-a3d0-15bb38e61318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:32.871958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d02422-90da-4f72-a3d0-15bb38e61318 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:32.891571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 671/1343] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:36.030990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7c7a-b632-4196-937e-e1eb6bb143f7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:36.031632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7c7a-b632-4196-937e-e1eb6bb143f7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:36.031847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f7c7a-b632-4196-937e-e1eb6bb143f7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:36.033450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 673/1344] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:36.040731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dbbe8-72b9-40ee-9d60-022898e23f52 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:36.041242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dbbe8-72b9-40ee-9d60-022898e23f52 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:36.041390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dbbe8-72b9-40ee-9d60-022898e23f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:36.112375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9f5dbbe8-72b9-40ee-9d60-022898e23f52 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:36.114212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f5dbbe8-72b9-40ee-9d60-022898e23f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:36.134531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:36.220903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 672/1345] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:36.518552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7c7a-b632-4196-937e-e1eb6bb143f7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:36.520417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5f1f7c7a-b632-4196-937e-e1eb6bb143f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:36.640613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f7c7a-b632-4196-937e-e1eb6bb143f7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:36.727163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53212-b846-45bb-b358-97847fe8cbe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:36.727978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53212-b846-45bb-b358-97847fe8cbe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:36.728320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53212-b846-45bb-b358-97847fe8cbe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:36.728655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53212-b846-45bb-b358-97847fe8cbe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:36.730472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c9d53212-b846-45bb-b358-97847fe8cbe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:36.782992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:36.858773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d53212-b846-45bb-b358-97847fe8cbe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:36.860366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d53212-b846-45bb-b358-97847fe8cbe2 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:36.881521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 674/1346] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:09:41.709441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914155-e3eb-4bd1-8fa6-21cd7f570b04 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:41.710065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914155-e3eb-4bd1-8fa6-21cd7f570b04 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:41.710065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914155-e3eb-4bd1-8fa6-21cd7f570b04 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:41.711318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 673/1347] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:09:41.717188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490740f-c32b-4c2f-930f-86769166e1fd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:41.717928 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490740f-c32b-4c2f-930f-86769166e1fd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:41.718135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490740f-c32b-4c2f-930f-86769166e1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:41.792134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8490740f-c32b-4c2f-930f-86769166e1fd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:41.793371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8490740f-c32b-4c2f-930f-86769166e1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:41.939623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:41.943912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 675/1348] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:42.237857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e914155-e3eb-4bd1-8fa6-21cd7f570b04 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:09:42.239976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7e914155-e3eb-4bd1-8fa6-21cd7f570b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:42.358980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e914155-e3eb-4bd1-8fa6-21cd7f570b04 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:09:42.417679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:42.456888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b16a6f-46bf-4fe1-bbd3-605bc10033bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:09:42.457737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16a6f-46bf-4fe1-bbd3-605bc10033bd service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:42.458174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16a6f-46bf-4fe1-bbd3-605bc10033bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:42.458456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b16a6f-46bf-4fe1-bbd3-605bc10033bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:42.460094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-53b16a6f-46bf-4fe1-bbd3-605bc10033bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:42.608566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b16a6f-46bf-4fe1-bbd3-605bc10033bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:09:42.612825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b16a6f-46bf-4fe1-bbd3-605bc10033bd service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:09:42.649352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 674/1349] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:09:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:09:47.997746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303b32-ffd8-471a-a1e4-632cb01abba7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:47.998684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303b32-ffd8-471a-a1e4-632cb01abba7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:47.999129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303b32-ffd8-471a-a1e4-632cb01abba7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:48.000686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 676/1350] 10.222.0.82 () {54 vars in 921 bytes} [Mon Aug 29 19:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:48.011358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13fef-69a3-494a-94ff-d2a4c503fe56 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:48.011358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13fef-69a3-494a-94ff-d2a4c503fe56 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:48.011358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13fef-69a3-494a-94ff-d2a4c503fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:48.136541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b6e13fef-69a3-494a-94ff-d2a4c503fe56 None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:48.136541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b6e13fef-69a3-494a-94ff-d2a4c503fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:48.158174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:48.312585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 675/1351] 10.222.0.82 () {58 vars in 1018 bytes} [Mon Aug 29 19:09:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:53.499701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a064-425f-44f2-8571-29a7733fd192 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:53.501017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a064-425f-44f2-8571-29a7733fd192 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:53.501732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0a064-425f-44f2-8571-29a7733fd192 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:53.504523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 677/1352] 10.222.0.82 () {54 vars in 921 bytes} [Mon Aug 29 19:09:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:53.513096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f270f-cc11-4697-ab1b-56db926843dc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:53.513965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f270f-cc11-4697-ab1b-56db926843dc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:53.514254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f270f-cc11-4697-ab1b-56db926843dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:53.618435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fc5f270f-cc11-4697-ab1b-56db926843dc None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:53.619768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fc5f270f-cc11-4697-ab1b-56db926843dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:53.704890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:53.754546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 676/1353] 10.222.0.82 () {58 vars in 1018 bytes} [Mon Aug 29 19:09:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:09:55.781079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313312e0-5bc7-4461-8c61-fc5225916552 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:55.781847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313312e0-5bc7-4461-8c61-fc5225916552 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:55.781847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313312e0-5bc7-4461-8c61-fc5225916552 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:55.783269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 678/1354] 10.222.0.82 () {54 vars in 921 bytes} [Mon Aug 29 19:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:09:55.789076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bfd33-34fb-4424-a33b-64cf4e65fc26 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:55.789899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bfd33-34fb-4424-a33b-64cf4e65fc26 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:55.790075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bfd33-34fb-4424-a33b-64cf4e65fc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:55.876273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-be2bfd33-34fb-4424-a33b-64cf4e65fc26 None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:55.877264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-be2bfd33-34fb-4424-a33b-64cf4e65fc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:56.003807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 677/1355] 10.222.0.82 () {58 vars in 1018 bytes} [Mon Aug 29 19:09:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:09:59.454057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948a14f-6f73-4993-bda0-4eaa9b00c780 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:59.454598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948a14f-6f73-4993-bda0-4eaa9b00c780 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:59.455133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948a14f-6f73-4993-bda0-4eaa9b00c780 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:59.463501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 679/1356] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:09:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:09:59.471453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dec94-ba72-4d93-aefe-4963c5a98785 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:59.472369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dec94-ba72-4d93-aefe-4963c5a98785 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:59.472877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dec94-ba72-4d93-aefe-4963c5a98785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:09:59.513096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:59.546596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1e9dec94-ba72-4d93-aefe-4963c5a98785 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:09:59.548841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1e9dec94-ba72-4d93-aefe-4963c5a98785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:09:59.660019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 678/1357] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:09:59.996061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ec91c-2815-4cc2-b0ea-fc4df7e31965 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:09:59.997839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ec91c-2815-4cc2-b0ea-fc4df7e31965 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:09:59.998518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ec91c-2815-4cc2-b0ea-fc4df7e31965 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:00.002033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 680/1358] 10.222.0.82 () {54 vars in 962 bytes} [Mon Aug 29 19:09:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:00.011706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e520-f747-4131-8764-8bc7bb7f67e2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:00.012664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e520-f747-4131-8764-8bc7bb7f67e2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:00.013412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026e520-f747-4131-8764-8bc7bb7f67e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:00.159311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6026e520-f747-4131-8764-8bc7bb7f67e2 None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:00.162678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6026e520-f747-4131-8764-8bc7bb7f67e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:00.246718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:00.349539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 679/1359] 10.222.0.82 () {58 vars in 1059 bytes} [Mon Aug 29 19:10:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:10:00.359879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ec91c-2815-4cc2-b0ea-fc4df7e31965 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:00.362269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-095ec91c-2815-4cc2-b0ea-fc4df7e31965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:00.587664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ec91c-2815-4cc2-b0ea-fc4df7e31965 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:00.687786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:00.755847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15acc5f-d536-45e9-920f-902e627d7339 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:00.756753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acc5f-d536-45e9-920f-902e627d7339 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:00.757171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acc5f-d536-45e9-920f-902e627d7339 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:00.757581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acc5f-d536-45e9-920f-902e627d7339 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:00.760208 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c15acc5f-d536-45e9-920f-902e627d7339 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:00.903339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15acc5f-d536-45e9-920f-902e627d7339 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:00.906084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15acc5f-d536-45e9-920f-902e627d7339 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:00.935714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 681/1360] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:03.298346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1b35-a162-42bd-90ce-e5841962eeaf None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:03.298948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1b35-a162-42bd-90ce-e5841962eeaf None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:03.299705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca1b35-a162-42bd-90ce-e5841962eeaf None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:03.303277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 680/1361] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:03.311183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0a4d-71e9-47b4-86de-70206b109824 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:03.311660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0a4d-71e9-47b4-86de-70206b109824 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:03.312083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe0a4d-71e9-47b4-86de-70206b109824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:03.400452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-babe0a4d-71e9-47b4-86de-70206b109824 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:03.401655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-babe0a4d-71e9-47b4-86de-70206b109824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:03.446227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:03.539335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 682/1362] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:03.995313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1b35-a162-42bd-90ce-e5841962eeaf None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:03.998079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-82ca1b35-a162-42bd-90ce-e5841962eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:04.261860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca1b35-a162-42bd-90ce-e5841962eeaf None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:04.277832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:04.412526 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111f000-1875-4548-95e1-9b4bdc1576bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:04.419345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111f000-1875-4548-95e1-9b4bdc1576bc service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:04.419345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111f000-1875-4548-95e1-9b4bdc1576bc service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:04.419345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111f000-1875-4548-95e1-9b4bdc1576bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:04.419345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d111f000-1875-4548-95e1-9b4bdc1576bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:04.514886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111f000-1875-4548-95e1-9b4bdc1576bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:04.516570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111f000-1875-4548-95e1-9b4bdc1576bc service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:04.541499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 681/1363] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:07.230855 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c473a6-2d7a-42ad-9968-6bb1ce24e347 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:07.231407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c473a6-2d7a-42ad-9968-6bb1ce24e347 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:07.231407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c473a6-2d7a-42ad-9968-6bb1ce24e347 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:07.232925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 683/1364] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:07.239199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332eff-b4d7-4d4b-b392-0e902a2d3e3b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:07.239675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332eff-b4d7-4d4b-b392-0e902a2d3e3b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:07.239815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de332eff-b4d7-4d4b-b392-0e902a2d3e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:07.256203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:07.312307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-de332eff-b4d7-4d4b-b392-0e902a2d3e3b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:07.313586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de332eff-b4d7-4d4b-b392-0e902a2d3e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:07.415368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 682/1365] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:07.717065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9cc05-35ec-4fc5-b593-acda07a4a2ab None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:07.717590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9cc05-35ec-4fc5-b593-acda07a4a2ab None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:07.717962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9cc05-35ec-4fc5-b593-acda07a4a2ab None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:07.719627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 684/1366] 10.222.0.82 () {54 vars in 962 bytes} [Mon Aug 29 19:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:07.725957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f850a2-d997-4ad0-aa41-1e00ba54ad9c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:07.726363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f850a2-d997-4ad0-aa41-1e00ba54ad9c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:07.726736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f850a2-d997-4ad0-aa41-1e00ba54ad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:07.813448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e7f850a2-d997-4ad0-aa41-1e00ba54ad9c None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:07.814921 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e7f850a2-d997-4ad0-aa41-1e00ba54ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:07.853801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:07.941543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 683/1367] 10.222.0.82 () {58 vars in 1059 bytes} [Mon Aug 29 19:10:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:07.950914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9cc05-35ec-4fc5-b593-acda07a4a2ab None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:07.952952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b4a9cc05-35ec-4fc5-b593-acda07a4a2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:08.121084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9cc05-35ec-4fc5-b593-acda07a4a2ab None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:08.150862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:08.269391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962959f-55bb-400a-b96a-56c0611f1906 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:08.270750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962959f-55bb-400a-b96a-56c0611f1906 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:08.271185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962959f-55bb-400a-b96a-56c0611f1906 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:08.271612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962959f-55bb-400a-b96a-56c0611f1906 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:08.273879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f962959f-55bb-400a-b96a-56c0611f1906 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:08.394991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962959f-55bb-400a-b96a-56c0611f1906 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:08.397226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962959f-55bb-400a-b96a-56c0611f1906 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:08.418097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 685/1368] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:10:08.944403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b190-d96c-4153-88eb-b833cca64b9a None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:08.944984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b190-d96c-4153-88eb-b833cca64b9a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:08.944984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b190-d96c-4153-88eb-b833cca64b9a None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:08.946442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 684/1369] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:08.951862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aef5b-241d-48db-8223-554e19a3c1ea None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:08.952145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aef5b-241d-48db-8223-554e19a3c1ea None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:08.952442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520aef5b-241d-48db-8223-554e19a3c1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:08.989325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:09.031236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-520aef5b-241d-48db-8223-554e19a3c1ea None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:09.032384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-520aef5b-241d-48db-8223-554e19a3c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:09.179542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 686/1370] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:09.778499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884bed-0607-4412-b65e-767d58a3e9ea None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:09.778777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884bed-0607-4412-b65e-767d58a3e9ea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:09.779048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c884bed-0607-4412-b65e-767d58a3e9ea None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:09.780593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 685/1371] 10.222.0.82 () {54 vars in 964 bytes} [Mon Aug 29 19:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:09.786344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303abb-a13a-4a94-9d44-727a5b432163 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:09.787267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303abb-a13a-4a94-9d44-727a5b432163 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:09.787267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38303abb-a13a-4a94-9d44-727a5b432163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:09.884914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-38303abb-a13a-4a94-9d44-727a5b432163 None None] MFA Rules not processed for user `1b55bbe406a04cf28244380f5b07eed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:09.886140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-38303abb-a13a-4a94-9d44-727a5b432163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:09.940545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:09.984826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 687/1372] 10.222.0.82 () {58 vars in 1061 bytes} [Mon Aug 29 19:10:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:09.992858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884bed-0607-4412-b65e-767d58a3e9ea None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:09.994376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9c884bed-0607-4412-b65e-767d58a3e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:10.115934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c884bed-0607-4412-b65e-767d58a3e9ea None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:10.165828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:10.204855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdef5d-d09f-4cc4-af73-961b6ccfef62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:10.205888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdef5d-d09f-4cc4-af73-961b6ccfef62 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:10.206555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdef5d-d09f-4cc4-af73-961b6ccfef62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:10.208194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdef5d-d09f-4cc4-af73-961b6ccfef62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:10.209919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fecdef5d-d09f-4cc4-af73-961b6ccfef62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:10.343542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdef5d-d09f-4cc4-af73-961b6ccfef62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:10.345215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdef5d-d09f-4cc4-af73-961b6ccfef62 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:10.369113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 686/1373] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:10.656880 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44037c5a-eef6-4e57-8402-1c0585eb5adc None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:10.657289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44037c5a-eef6-4e57-8402-1c0585eb5adc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:10.657723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44037c5a-eef6-4e57-8402-1c0585eb5adc None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:10.660893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 688/1374] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:10.668027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9437f7-09bb-45eb-b717-55f284557d82 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:10.668622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9437f7-09bb-45eb-b717-55f284557d82 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:10.669148 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9437f7-09bb-45eb-b717-55f284557d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:10.764962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fa9437f7-09bb-45eb-b717-55f284557d82 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:10.767031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fa9437f7-09bb-45eb-b717-55f284557d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:10.800054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:10.911307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 687/1375] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:11.213471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44037c5a-eef6-4e57-8402-1c0585eb5adc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:11.215474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-44037c5a-eef6-4e57-8402-1c0585eb5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:11.402021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44037c5a-eef6-4e57-8402-1c0585eb5adc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:11.470247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:11.545409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5c9dc-6546-4f29-8838-231eec90d924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:11.546626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5c9dc-6546-4f29-8838-231eec90d924 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:11.547015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5c9dc-6546-4f29-8838-231eec90d924 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:11.547396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5c9dc-6546-4f29-8838-231eec90d924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:11.549330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aba5c9dc-6546-4f29-8838-231eec90d924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:11.657622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5c9dc-6546-4f29-8838-231eec90d924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:11.659624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5c9dc-6546-4f29-8838-231eec90d924 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:11.686794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 689/1376] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:13.849859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b332774-41e2-4341-8fa1-4b684f1c8219 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:13.850429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b332774-41e2-4341-8fa1-4b684f1c8219 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:13.850543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b332774-41e2-4341-8fa1-4b684f1c8219 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:13.851839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 688/1377] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:13.857058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfc7a-ac04-46db-b100-a42f73bb7d39 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:13.857517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfc7a-ac04-46db-b100-a42f73bb7d39 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:13.857615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbfc7a-ac04-46db-b100-a42f73bb7d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:13.942989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-81dbfc7a-ac04-46db-b100-a42f73bb7d39 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:13.944186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-81dbfc7a-ac04-46db-b100-a42f73bb7d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:13.951532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:14.044748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 690/1378] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:14.384404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b332774-41e2-4341-8fa1-4b684f1c8219 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:14.386424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8b332774-41e2-4341-8fa1-4b684f1c8219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:14.584908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b332774-41e2-4341-8fa1-4b684f1c8219 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:14.588901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:14.724500 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5eb6f-7f51-4755-bdba-adc98903d32e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:14.725418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5eb6f-7f51-4755-bdba-adc98903d32e service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:14.725786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5eb6f-7f51-4755-bdba-adc98903d32e service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:14.726257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5eb6f-7f51-4755-bdba-adc98903d32e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:14.728102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5bd5eb6f-7f51-4755-bdba-adc98903d32e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:14.843400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5eb6f-7f51-4755-bdba-adc98903d32e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:14.844944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5eb6f-7f51-4755-bdba-adc98903d32e service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:14.864693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 689/1379] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:17.038346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605c628-0161-402c-8af7-e9b4afaf98a9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:17.038929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605c628-0161-402c-8af7-e9b4afaf98a9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:17.038929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605c628-0161-402c-8af7-e9b4afaf98a9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:17.040552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 691/1380] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:17.045614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9796359-e202-4091-ad5b-50f2a63a2efd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:17.046057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9796359-e202-4091-ad5b-50f2a63a2efd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:17.046150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9796359-e202-4091-ad5b-50f2a63a2efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:17.059153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:17.118560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c9796359-e202-4091-ad5b-50f2a63a2efd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:17.119672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c9796359-e202-4091-ad5b-50f2a63a2efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:17.242114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 690/1381] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:10:17.537009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605c628-0161-402c-8af7-e9b4afaf98a9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:17.538509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a605c628-0161-402c-8af7-e9b4afaf98a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:17.688205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:17.699217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605c628-0161-402c-8af7-e9b4afaf98a9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:17.821786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3169199-b5ff-483e-9dbf-4b04c04e0bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:17.822286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169199-b5ff-483e-9dbf-4b04c04e0bb4 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:17.822576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169199-b5ff-483e-9dbf-4b04c04e0bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:17.822880 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169199-b5ff-483e-9dbf-4b04c04e0bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:17.824429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a3169199-b5ff-483e-9dbf-4b04c04e0bb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:17.931075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3169199-b5ff-483e-9dbf-4b04c04e0bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:17.932841 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3169199-b5ff-483e-9dbf-4b04c04e0bb4 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:17.944703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:17.953423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 692/1382] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:20.882720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d8b2-583d-4c7a-9461-c7d5b33a7281 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:20.883674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d8b2-583d-4c7a-9461-c7d5b33a7281 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:20.883674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d8b2-583d-4c7a-9461-c7d5b33a7281 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:20.885638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 691/1383] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:20.892439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8f541-bb9b-4152-a724-bf007e5c5783 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:20.892874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8f541-bb9b-4152-a724-bf007e5c5783 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:20.895859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8f541-bb9b-4152-a724-bf007e5c5783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:20.974962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9bd8f541-bb9b-4152-a724-bf007e5c5783 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:20.976512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9bd8f541-bb9b-4152-a724-bf007e5c5783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:21.095506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 693/1384] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:10:21.394657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d8b2-583d-4c7a-9461-c7d5b33a7281 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:21.396297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c145d8b2-583d-4c7a-9461-c7d5b33a7281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:21.497339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:21.562553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d8b2-583d-4c7a-9461-c7d5b33a7281 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:21.696763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89eab1-3bf6-4c92-b974-e6e2263a6f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:21.697421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89eab1-3bf6-4c92-b974-e6e2263a6f6d service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:21.697788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89eab1-3bf6-4c92-b974-e6e2263a6f6d service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:21.698138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89eab1-3bf6-4c92-b974-e6e2263a6f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:21.699794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0b89eab1-3bf6-4c92-b974-e6e2263a6f6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:21.760428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:21.811452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89eab1-3bf6-4c92-b974-e6e2263a6f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:21.814381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89eab1-3bf6-4c92-b974-e6e2263a6f6d service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:21.839710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 692/1385] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:10:23.879259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ff534-6bbf-46d2-aa67-dec43c56cd9b None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:23.880108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ff534-6bbf-46d2-aa67-dec43c56cd9b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:23.880108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ff534-6bbf-46d2-aa67-dec43c56cd9b None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:23.881493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 694/1386] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:23.888546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4b084-b66b-4d73-a126-14fa1caa8873 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:23.889592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4b084-b66b-4d73-a126-14fa1caa8873 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:23.890341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4b084-b66b-4d73-a126-14fa1caa8873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:23.968498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7cc4b084-b66b-4d73-a126-14fa1caa8873 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:23.969755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7cc4b084-b66b-4d73-a126-14fa1caa8873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:24.098413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 693/1387] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:10:24.406272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ff534-6bbf-46d2-aa67-dec43c56cd9b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:24.410607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cd9ff534-6bbf-46d2-aa67-dec43c56cd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:24.498563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:24.574439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ff534-6bbf-46d2-aa67-dec43c56cd9b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:24.740527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8833b-a4ff-489d-b011-c02a50e46b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:24.741340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8833b-a4ff-489d-b011-c02a50e46b53 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:24.741876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8833b-a4ff-489d-b011-c02a50e46b53 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:24.742210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8833b-a4ff-489d-b011-c02a50e46b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:24.744424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2ca8833b-a4ff-489d-b011-c02a50e46b53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:24.801501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:24.884789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8833b-a4ff-489d-b011-c02a50e46b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:24.886494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8833b-a4ff-489d-b011-c02a50e46b53 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:24.910696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 695/1388] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:10:26.973376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452a5d-4dea-45b1-9495-4a3dcd2b23e2 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:26.973376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452a5d-4dea-45b1-9495-4a3dcd2b23e2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:26.974035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452a5d-4dea-45b1-9495-4a3dcd2b23e2 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:26.974917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 694/1389] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:26.981086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6af5f-3c44-4bc7-a3ac-b1123164d433 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:26.981801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6af5f-3c44-4bc7-a3ac-b1123164d433 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:26.981801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6af5f-3c44-4bc7-a3ac-b1123164d433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:27.012738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e51ae-1c53-4130-a90c-a3ee5d1e1c9c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:27.013166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e51ae-1c53-4130-a90c-a3ee5d1e1c9c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:27.013661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e51ae-1c53-4130-a90c-a3ee5d1e1c9c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:27.015840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 695/1390] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:10:27.021952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466acbc-24d3-44dc-b8d9-4052d4997ccf None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:27.022328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466acbc-24d3-44dc-b8d9-4052d4997ccf None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:27.022527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466acbc-24d3-44dc-b8d9-4052d4997ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:27.079702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:27.139053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7466acbc-24d3-44dc-b8d9-4052d4997ccf None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:27.140378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7466acbc-24d3-44dc-b8d9-4052d4997ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:27.192634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f1a6af5f-3c44-4bc7-a3ac-b1123164d433 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:27.193921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f1a6af5f-3c44-4bc7-a3ac-b1123164d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:27.251344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 696/1391] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:10:27.299982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 696/1392] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:10:27.548253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466acbc-24d3-44dc-b8d9-4052d4997ccf None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:27.549498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7466acbc-24d3-44dc-b8d9-4052d4997ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:27.616704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b26b0-a4bd-4b77-ab10-4adbed04e76b None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:27.617019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b26b0-a4bd-4b77-ab10-4adbed04e76b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:27.617292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b26b0-a4bd-4b77-ab10-4adbed04e76b None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:27.618689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 697/1393] 10.222.0.82 () {54 vars in 967 bytes} [Mon Aug 29 19:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:27.623602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02647e8-4fee-4a94-8841-a04fff9b19fa None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:27.623935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02647e8-4fee-4a94-8841-a04fff9b19fa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:27.624215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02647e8-4fee-4a94-8841-a04fff9b19fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:27.640981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:27.681143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:27.689100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466acbc-24d3-44dc-b8d9-4052d4997ccf None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:27.707551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f02647e8-4fee-4a94-8841-a04fff9b19fa None None] MFA Rules not processed for user `5786ad6388c54a3f82955e12e8e8f8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:27.708819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f02647e8-4fee-4a94-8841-a04fff9b19fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:27.798160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 698/1394] 10.222.0.82 () {58 vars in 1064 bytes} [Mon Aug 29 19:10:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:10:27.810641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02647e8-4fee-4a94-8841-a04fff9b19fa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:27.820796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1011619-cda8-47e1-ba30-553b4ea0c936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:27.821453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011619-cda8-47e1-ba30-553b4ea0c936 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:27.821741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011619-cda8-47e1-ba30-553b4ea0c936 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:27.822012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1011619-cda8-47e1-ba30-553b4ea0c936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:27.823633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d1011619-cda8-47e1-ba30-553b4ea0c936 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:27.824857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02647e8-4fee-4a94-8841-a04fff9b19fa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:27.918041 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1011619-cda8-47e1-ba30-553b4ea0c936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:27.919629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1011619-cda8-47e1-ba30-553b4ea0c936 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:27.926073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4645dd-c09e-4480-afc8-3f63b513d482 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5786ad6388c54a3f82955e12e8e8f8b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:27.926775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4645dd-c09e-4480-afc8-3f63b513d482 service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:27.927110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4645dd-c09e-4480-afc8-3f63b513d482 service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:27.927366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4645dd-c09e-4480-afc8-3f63b513d482 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:27.929110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0e4645dd-c09e-4480-afc8-3f63b513d482 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:27.936179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:27.940761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 697/1395] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:27.962921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:28.044024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4645dd-c09e-4480-afc8-3f63b513d482 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:28.045587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4645dd-c09e-4480-afc8-3f63b513d482 service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:28.065486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 699/1396] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:10:29.024083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162df598-6aa5-4907-9368-1b74b9bf38dd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:29.024742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162df598-6aa5-4907-9368-1b74b9bf38dd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:29.025349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162df598-6aa5-4907-9368-1b74b9bf38dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:29.107901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-162df598-6aa5-4907-9368-1b74b9bf38dd None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:29.109009 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-162df598-6aa5-4907-9368-1b74b9bf38dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:29.201434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 698/1397] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:10:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:29.251986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78bfa-79cc-4e9f-bc72-86b17e433fe7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:29.252641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78bfa-79cc-4e9f-bc72-86b17e433fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:29.252641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d78bfa-79cc-4e9f-bc72-86b17e433fe7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:29.255057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 700/1398] 10.222.0.82 () {54 vars in 943 bytes} [Mon Aug 29 19:10:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:29.261736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2dff-33ea-4f5d-8460-62f1fe8e8547 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:29.262029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2dff-33ea-4f5d-8460-62f1fe8e8547 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:29.262309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2dff-33ea-4f5d-8460-62f1fe8e8547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:29.345818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7b1b2dff-33ea-4f5d-8460-62f1fe8e8547 None None] MFA Rules not processed for user `209e9c8c1a0b41b58f51e94e4bd6c3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:29.347079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7b1b2dff-33ea-4f5d-8460-62f1fe8e8547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:29.381808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:29.464495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 699/1399] 10.222.0.82 () {58 vars in 1040 bytes} [Mon Aug 29 19:10:29 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:29.474917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78bfa-79cc-4e9f-bc72-86b17e433fe7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:29.479636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-23d78bfa-79cc-4e9f-bc72-86b17e433fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:29.622118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:29.624493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d78bfa-79cc-4e9f-bc72-86b17e433fe7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:29.743056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9f031-b538-4085-a80c-aff5076a4a22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:29.743654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f031-b538-4085-a80c-aff5076a4a22 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:29.743961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f031-b538-4085-a80c-aff5076a4a22 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:29.744233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9f031-b538-4085-a80c-aff5076a4a22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:29.745855 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-59a9f031-b538-4085-a80c-aff5076a4a22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:29.846546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9f031-b538-4085-a80c-aff5076a4a22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:29.848576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9f031-b538-4085-a80c-aff5076a4a22 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:29.857347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 701/1400] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:10:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:10:30.096427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134fc3-333e-4e58-9b57-81c7dcb68e5b None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:30.096957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134fc3-333e-4e58-9b57-81c7dcb68e5b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:30.096957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73134fc3-333e-4e58-9b57-81c7dcb68e5b None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:30.099192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 700/1401] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:30.104528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e84b63-8897-4b64-8161-07b67a183c0a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:30.104818 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e84b63-8897-4b64-8161-07b67a183c0a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:30.105098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e84b63-8897-4b64-8161-07b67a183c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:30.144649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:30.183164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a9e84b63-8897-4b64-8161-07b67a183c0a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:30.184407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a9e84b63-8897-4b64-8161-07b67a183c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:30.296957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 702/1402] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:30.610508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73134fc3-333e-4e58-9b57-81c7dcb68e5b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:30.612163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-73134fc3-333e-4e58-9b57-81c7dcb68e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:30.806745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73134fc3-333e-4e58-9b57-81c7dcb68e5b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:30.818513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:30.982027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8579c7-8962-4ea1-af34-dc27a9251506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:30.982653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8579c7-8962-4ea1-af34-dc27a9251506 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:30.982937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8579c7-8962-4ea1-af34-dc27a9251506 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:30.983715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8579c7-8962-4ea1-af34-dc27a9251506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:30.984916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2c8579c7-8962-4ea1-af34-dc27a9251506 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:31.095241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8579c7-8962-4ea1-af34-dc27a9251506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:31.097275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8579c7-8962-4ea1-af34-dc27a9251506 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:31.116922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 701/1403] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:33.443750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec362-1839-4f9c-9171-05aa916a8a3c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:33.444620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec362-1839-4f9c-9171-05aa916a8a3c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:33.444620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec362-1839-4f9c-9171-05aa916a8a3c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:33.446940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 703/1404] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:10:33.458701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6822-0af2-432d-89f7-1fa1ed9c9172 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:33.459372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6822-0af2-432d-89f7-1fa1ed9c9172 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:33.459580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a6822-0af2-432d-89f7-1fa1ed9c9172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:33.526915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:33.580978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8e7a6822-0af2-432d-89f7-1fa1ed9c9172 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:33.582589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8e7a6822-0af2-432d-89f7-1fa1ed9c9172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:33.762230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 702/1405] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:34.179247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caec362-1839-4f9c-9171-05aa916a8a3c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:34.220640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1caec362-1839-4f9c-9171-05aa916a8a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:34.389043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:34.459771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caec362-1839-4f9c-9171-05aa916a8a3c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:34.664058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805f761-c58a-46f4-84d3-b34f0a061282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:34.664760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805f761-c58a-46f4-84d3-b34f0a061282 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:34.665103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805f761-c58a-46f4-84d3-b34f0a061282 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:34.665381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805f761-c58a-46f4-84d3-b34f0a061282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:34.667045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d805f761-c58a-46f4-84d3-b34f0a061282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:34.773030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:34.805114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805f761-c58a-46f4-84d3-b34f0a061282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:34.806765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d805f761-c58a-46f4-84d3-b34f0a061282 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:34.827245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 704/1406] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:37.467024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c5915-06a4-4ea4-be2b-a9349f672f1c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:37.468112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c5915-06a4-4ea4-be2b-a9349f672f1c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:37.468742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c5915-06a4-4ea4-be2b-a9349f672f1c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:37.470581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 703/1407] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:10:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:37.476912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66063e1-4566-4fb9-9715-1bc2810eee64 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:37.477810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66063e1-4566-4fb9-9715-1bc2810eee64 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:37.478310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66063e1-4566-4fb9-9715-1bc2810eee64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:37.571117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f66063e1-4566-4fb9-9715-1bc2810eee64 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:37.572494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f66063e1-4566-4fb9-9715-1bc2810eee64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:37.695947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 705/1408] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:38.032133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c5915-06a4-4ea4-be2b-a9349f672f1c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:38.034016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ba3c5915-06a4-4ea4-be2b-a9349f672f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:38.155882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:38.297555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c5915-06a4-4ea4-be2b-a9349f672f1c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:38.466484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40618d55-676a-4f96-bc69-15de0da7815a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:38.467107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40618d55-676a-4f96-bc69-15de0da7815a service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:38.467667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40618d55-676a-4f96-bc69-15de0da7815a service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:38.467667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40618d55-676a-4f96-bc69-15de0da7815a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:38.469482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-40618d55-676a-4f96-bc69-15de0da7815a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:38.531013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:38.583584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40618d55-676a-4f96-bc69-15de0da7815a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:38.583584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40618d55-676a-4f96-bc69-15de0da7815a service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:38.607323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 704/1409] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:10:47.690408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=79 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:48.604399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=23 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:54.664445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720648de-3718-4ec0-a27f-b099a97c9f4d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:54.665093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720648de-3718-4ec0-a27f-b099a97c9f4d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:54.665093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720648de-3718-4ec0-a27f-b099a97c9f4d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:54.666330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 706/1410] 10.222.0.82 () {54 vars in 918 bytes} [Mon Aug 29 19:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:10:54.671690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc367da-1bdb-4c2d-8951-1cddb59b939f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:54.672250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc367da-1bdb-4c2d-8951-1cddb59b939f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:54.672250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc367da-1bdb-4c2d-8951-1cddb59b939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:54.751735 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8dc367da-1bdb-4c2d-8951-1cddb59b939f None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:54.754312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8dc367da-1bdb-4c2d-8951-1cddb59b939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:54.866864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 705/1411] 10.222.0.82 () {58 vars in 1015 bytes} [Mon Aug 29 19:10:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:54.882626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31f14-9c31-462f-ad55-4f26e29edeaa None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:54.882921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31f14-9c31-462f-ad55-4f26e29edeaa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:54.883176 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31f14-9c31-462f-ad55-4f26e29edeaa None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:54.884642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 707/1412] 10.222.0.82 () {54 vars in 918 bytes} [Mon Aug 29 19:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:54.889856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59780f9-27df-49d8-b3c7-505e26d6097b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:54.890269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59780f9-27df-49d8-b3c7-505e26d6097b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:54.890652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59780f9-27df-49d8-b3c7-505e26d6097b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:54.968496 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:54.972809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f59780f9-27df-49d8-b3c7-505e26d6097b None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:54.974082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f59780f9-27df-49d8-b3c7-505e26d6097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:55.109258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 706/1413] 10.222.0.82 () {58 vars in 1015 bytes} [Mon Aug 29 19:10:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:57.617582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1897-433a-4e0a-bc9a-b5f4d43b2e32 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:57.618224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1897-433a-4e0a-bc9a-b5f4d43b2e32 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:57.618224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1897-433a-4e0a-bc9a-b5f4d43b2e32 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:57.619519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:57.625232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b580da-4b8c-4054-b18a-55618713d81f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:57.625687 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b580da-4b8c-4054-b18a-55618713d81f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:57.625829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b580da-4b8c-4054-b18a-55618713d81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:57.696955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f4b580da-4b8c-4054-b18a-55618713d81f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:57.698182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f4b580da-4b8c-4054-b18a-55618713d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:57.758708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:57.802974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:58.093681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da1897-433a-4e0a-bc9a-b5f4d43b2e32 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:58.095439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-92da1897-433a-4e0a-bc9a-b5f4d43b2e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:58.269299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da1897-433a-4e0a-bc9a-b5f4d43b2e32 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:10:58.368510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:58.417201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab9804-68b1-4e65-ba54-7194c4a28656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:10:58.417781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab9804-68b1-4e65-ba54-7194c4a28656 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:58.418057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab9804-68b1-4e65-ba54-7194c4a28656 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:58.418328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab9804-68b1-4e65-ba54-7194c4a28656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:58.420020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5eab9804-68b1-4e65-ba54-7194c4a28656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:58.514331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab9804-68b1-4e65-ba54-7194c4a28656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:10:58.516185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab9804-68b1-4e65-ba54-7194c4a28656 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:10:58.535164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 709/1416] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:10:59.485185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6fade-3d5b-4147-8992-21f988fedfbb None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:59.485732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6fade-3d5b-4147-8992-21f988fedfbb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:59.485732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c6fade-3d5b-4147-8992-21f988fedfbb None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:59.487084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:10:59.493782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab76b7-5b7d-406c-83f6-d387c7fcf73e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:10:59.494323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab76b7-5b7d-406c-83f6-d387c7fcf73e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:10:59.494323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab76b7-5b7d-406c-83f6-d387c7fcf73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:10:59.588005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0eab76b7-5b7d-406c-83f6-d387c7fcf73e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:10:59.589230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0eab76b7-5b7d-406c-83f6-d387c7fcf73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:10:59.618835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:59.704242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:10:59.858676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6fade-3d5b-4147-8992-21f988fedfbb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:10:59.860193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-06c6fade-3d5b-4147-8992-21f988fedfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:00.009138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c6fade-3d5b-4147-8992-21f988fedfbb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:00.049304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:00.122977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af0a57-e13d-4d15-a539-a99ef0775042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:00.123527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0a57-e13d-4d15-a539-a99ef0775042 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:00.123832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0a57-e13d-4d15-a539-a99ef0775042 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:00.124103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af0a57-e13d-4d15-a539-a99ef0775042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:00.125684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-78af0a57-e13d-4d15-a539-a99ef0775042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:00.215711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af0a57-e13d-4d15-a539-a99ef0775042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:00.217618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af0a57-e13d-4d15-a539-a99ef0775042 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:00.236374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 709/1419] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:01.157949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866632f0-b509-48ca-b983-a2b567d06455 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:01.158515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866632f0-b509-48ca-b983-a2b567d06455 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:01.158515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866632f0-b509-48ca-b983-a2b567d06455 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:01.160517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:01.166612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c90a0-f0dc-4ec1-94c1-7eb7a5216b41 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:01.167140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c90a0-f0dc-4ec1-94c1-7eb7a5216b41 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:01.167248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c90a0-f0dc-4ec1-94c1-7eb7a5216b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:01.225800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:01.252050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fa3c90a0-f0dc-4ec1-94c1-7eb7a5216b41 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:01.253857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fa3c90a0-f0dc-4ec1-94c1-7eb7a5216b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:01.352388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:01.519070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866632f0-b509-48ca-b983-a2b567d06455 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:01.520719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-866632f0-b509-48ca-b983-a2b567d06455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:01.672820 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866632f0-b509-48ca-b983-a2b567d06455 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:01.685557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:01.791793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52f132-1e5f-40ce-b4fd-79a7e6435011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:01.792331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f132-1e5f-40ce-b4fd-79a7e6435011 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:01.792613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f132-1e5f-40ce-b4fd-79a7e6435011 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:01.792886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52f132-1e5f-40ce-b4fd-79a7e6435011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:01.794596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fc52f132-1e5f-40ce-b4fd-79a7e6435011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:01.885245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52f132-1e5f-40ce-b4fd-79a7e6435011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:01.886845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52f132-1e5f-40ce-b4fd-79a7e6435011 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:01.905790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 712/1422] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:11:02.803771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c7f4-ff63-484f-b588-58d921191b9f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:02.804328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c7f4-ff63-484f-b588-58d921191b9f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:02.804328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29c7f4-ff63-484f-b588-58d921191b9f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:02.805580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:02.811017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31166f1-2af0-47ea-a116-4e6d4dae2e53 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:02.811520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31166f1-2af0-47ea-a116-4e6d4dae2e53 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:02.811617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31166f1-2af0-47ea-a116-4e6d4dae2e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:02.834844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:02.900220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a31166f1-2af0-47ea-a116-4e6d4dae2e53 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:02.901393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a31166f1-2af0-47ea-a116-4e6d4dae2e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:02.999208 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:03.152550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29c7f4-ff63-484f-b588-58d921191b9f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:03.153982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bc29c7f4-ff63-484f-b588-58d921191b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:03.272294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:03.308501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29c7f4-ff63-484f-b588-58d921191b9f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:03.423890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6146b13-bfec-4ce0-8c75-d4baca0bbd39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:03.424421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6146b13-bfec-4ce0-8c75-d4baca0bbd39 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:03.424704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6146b13-bfec-4ce0-8c75-d4baca0bbd39 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:03.425706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6146b13-bfec-4ce0-8c75-d4baca0bbd39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:03.427374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b6146b13-bfec-4ce0-8c75-d4baca0bbd39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:03.503891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:03.517141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6146b13-bfec-4ce0-8c75-d4baca0bbd39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:03.518837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6146b13-bfec-4ce0-8c75-d4baca0bbd39 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:03.537556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 712/1425] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:04.417332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea904-6591-4e82-b179-9af42a90828b None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:04.417874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea904-6591-4e82-b179-9af42a90828b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:04.417874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ea904-6591-4e82-b179-9af42a90828b None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:04.419237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:04.424253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9e61-31dc-4e30-8d2a-2ec1ed1aeb72 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:04.424713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9e61-31dc-4e30-8d2a-2ec1ed1aeb72 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:04.425436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e9e61-31dc-4e30-8d2a-2ec1ed1aeb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:04.505046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6e2e9e61-31dc-4e30-8d2a-2ec1ed1aeb72 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:04.506268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6e2e9e61-31dc-4e30-8d2a-2ec1ed1aeb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:04.604545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:04.762416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ea904-6591-4e82-b179-9af42a90828b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:04.763897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b05ea904-6591-4e82-b179-9af42a90828b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:04.857207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:04.918320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ea904-6591-4e82-b179-9af42a90828b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:05.031281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45071cb0-8fa2-41ed-bcfb-c4f34e52714c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:05.031863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071cb0-8fa2-41ed-bcfb-c4f34e52714c service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:05.032146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071cb0-8fa2-41ed-bcfb-c4f34e52714c service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:05.032426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071cb0-8fa2-41ed-bcfb-c4f34e52714c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:05.034023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-45071cb0-8fa2-41ed-bcfb-c4f34e52714c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:05.084202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:05.125762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45071cb0-8fa2-41ed-bcfb-c4f34e52714c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:05.127524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45071cb0-8fa2-41ed-bcfb-c4f34e52714c service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:05.145940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 715/1428] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:06.032812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9d146-c0cc-46c7-a56f-7086cbaf00e8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:06.033475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9d146-c0cc-46c7-a56f-7086cbaf00e8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:06.033475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9d146-c0cc-46c7-a56f-7086cbaf00e8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:06.035287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:06.040532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784e30a-1250-4ab2-a3c0-5be31dfb706d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:06.040969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784e30a-1250-4ab2-a3c0-5be31dfb706d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:06.041110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784e30a-1250-4ab2-a3c0-5be31dfb706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:06.117894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2784e30a-1250-4ab2-a3c0-5be31dfb706d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:06.119099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2784e30a-1250-4ab2-a3c0-5be31dfb706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:06.216907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:06.370308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9d146-c0cc-46c7-a56f-7086cbaf00e8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:06.371796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0ea9d146-c0cc-46c7-a56f-7086cbaf00e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:06.421069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:06.522355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9d146-c0cc-46c7-a56f-7086cbaf00e8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:06.635997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38a521-fd01-447b-87ab-535132bb0382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:06.636522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38a521-fd01-447b-87ab-535132bb0382 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:06.636800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38a521-fd01-447b-87ab-535132bb0382 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:06.637072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38a521-fd01-447b-87ab-535132bb0382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:06.638661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6a38a521-fd01-447b-87ab-535132bb0382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:06.645938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:06.730713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38a521-fd01-447b-87ab-535132bb0382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:06.732346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38a521-fd01-447b-87ab-535132bb0382 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:06.750906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 715/1431] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:07.638329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a049-21cd-4598-a025-b8f4e1bde766 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:07.638907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a049-21cd-4598-a025-b8f4e1bde766 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:07.638907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43a049-21cd-4598-a025-b8f4e1bde766 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:07.640265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:07.647821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173d9a-a77c-46d9-b37f-6bfd2d4c425a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:07.649009 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173d9a-a77c-46d9-b37f-6bfd2d4c425a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:07.649874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173d9a-a77c-46d9-b37f-6bfd2d4c425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:07.730498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-52173d9a-a77c-46d9-b37f-6bfd2d4c425a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:07.731806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-52173d9a-a77c-46d9-b37f-6bfd2d4c425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:07.800679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:07.829587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:07.993646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43a049-21cd-4598-a025-b8f4e1bde766 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:07.995156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3e43a049-21cd-4598-a025-b8f4e1bde766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:08.012643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:08.140291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43a049-21cd-4598-a025-b8f4e1bde766 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:08.229304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:08.254854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873778a2-c8c8-4d1b-8266-8cdf3b194ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:08.255411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873778a2-c8c8-4d1b-8266-8cdf3b194ab6 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:08.255683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873778a2-c8c8-4d1b-8266-8cdf3b194ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:08.255979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873778a2-c8c8-4d1b-8266-8cdf3b194ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:08.257588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-873778a2-c8c8-4d1b-8266-8cdf3b194ab6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:08.345892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873778a2-c8c8-4d1b-8266-8cdf3b194ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:08.348220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873778a2-c8c8-4d1b-8266-8cdf3b194ab6 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:08.370025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 718/1434] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:09.304313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e39e2-d74c-4f40-8fa3-867ad5c86dda None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:09.304955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e39e2-d74c-4f40-8fa3-867ad5c86dda None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:09.304955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e39e2-d74c-4f40-8fa3-867ad5c86dda None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:09.306552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:09.311796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b05af-9d68-4bf4-a98a-7cf10ca8e5a2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:09.312216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b05af-9d68-4bf4-a98a-7cf10ca8e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:09.312354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b05af-9d68-4bf4-a98a-7cf10ca8e5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:09.399697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b35b05af-9d68-4bf4-a98a-7cf10ca8e5a2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:09.400960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b35b05af-9d68-4bf4-a98a-7cf10ca8e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:09.446406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:09.504210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:09.657945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e39e2-d74c-4f40-8fa3-867ad5c86dda None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:09.660121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bf5e39e2-d74c-4f40-8fa3-867ad5c86dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:09.810250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e39e2-d74c-4f40-8fa3-867ad5c86dda None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:09.866360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:09.927016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15080d2d-4d2b-4306-80a1-99e0ac01a612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:09.927633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15080d2d-4d2b-4306-80a1-99e0ac01a612 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:09.927944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15080d2d-4d2b-4306-80a1-99e0ac01a612 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:09.928221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15080d2d-4d2b-4306-80a1-99e0ac01a612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:09.929845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-15080d2d-4d2b-4306-80a1-99e0ac01a612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:10.023364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15080d2d-4d2b-4306-80a1-99e0ac01a612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:10.025004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15080d2d-4d2b-4306-80a1-99e0ac01a612 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:10.043065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 718/1437] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:10.981812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b28eb-a379-4e2c-9638-c5eef212103f None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:10.982392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b28eb-a379-4e2c-9638-c5eef212103f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:10.982392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b28eb-a379-4e2c-9638-c5eef212103f None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:10.983680 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:10.989228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715404-1509-49ee-89ea-c6adb3ee3eea None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:10.989681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715404-1509-49ee-89ea-c6adb3ee3eea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:10.989797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715404-1509-49ee-89ea-c6adb3ee3eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:11.068001 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6d715404-1509-49ee-89ea-c6adb3ee3eea None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:11.069224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6d715404-1509-49ee-89ea-c6adb3ee3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:11.071297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:11.170206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:11.340409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b28eb-a379-4e2c-9638-c5eef212103f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:11.342147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-343b28eb-a379-4e2c-9638-c5eef212103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:11.494988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b28eb-a379-4e2c-9638-c5eef212103f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:11.523168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:11.616452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dc454-154e-4198-8309-e96223ae349e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:11.617004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc454-154e-4198-8309-e96223ae349e service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:11.617290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc454-154e-4198-8309-e96223ae349e service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:11.617587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dc454-154e-4198-8309-e96223ae349e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:11.619293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-924dc454-154e-4198-8309-e96223ae349e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:11.714101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dc454-154e-4198-8309-e96223ae349e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:11.715830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dc454-154e-4198-8309-e96223ae349e service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:11.734389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 721/1440] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:13.604313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd8428-25a9-4419-a4cd-a7c2e1e59c7e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:13.604911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd8428-25a9-4419-a4cd-a7c2e1e59c7e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:13.604911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd8428-25a9-4419-a4cd-a7c2e1e59c7e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:13.606208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:13.611607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4f9e-4b13-4293-9c65-72612c1f0864 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:13.612086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4f9e-4b13-4293-9c65-72612c1f0864 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:13.612878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4f9e-4b13-4293-9c65-72612c1f0864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:13.655135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:13.681830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-27ce4f9e-4b13-4293-9c65-72612c1f0864 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:13.682614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-27ce4f9e-4b13-4293-9c65-72612c1f0864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:13.791202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:14.092944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd8428-25a9-4419-a4cd-a7c2e1e59c7e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:14.094475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-52bd8428-25a9-4419-a4cd-a7c2e1e59c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:14.201970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd8428-25a9-4419-a4cd-a7c2e1e59c7e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:14.235225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:14.287553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd509db-b5d0-481d-8055-9b991791ea8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:14.288212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd509db-b5d0-481d-8055-9b991791ea8f service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:14.288492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd509db-b5d0-481d-8055-9b991791ea8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:14.291204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd509db-b5d0-481d-8055-9b991791ea8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:14.291204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4fd509db-b5d0-481d-8055-9b991791ea8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:14.402111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd509db-b5d0-481d-8055-9b991791ea8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:14.403459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd509db-b5d0-481d-8055-9b991791ea8f service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:14.423154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 721/1443] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:11:16.554899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc203-dc01-4e09-8716-f9c0a1b228a0 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:16.555422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc203-dc01-4e09-8716-f9c0a1b228a0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:16.555422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedc203-dc01-4e09-8716-f9c0a1b228a0 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:16.556924 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:16.562555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c44f-001a-4bb1-bb0d-9b2319e19ffe None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:16.562983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c44f-001a-4bb1-bb0d-9b2319e19ffe None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:16.563134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0c44f-001a-4bb1-bb0d-9b2319e19ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:16.638403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a7d0c44f-001a-4bb1-bb0d-9b2319e19ffe None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:16.639619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a7d0c44f-001a-4bb1-bb0d-9b2319e19ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:16.653591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:16.760664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:17.050815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedc203-dc01-4e09-8716-f9c0a1b228a0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:17.052544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4dedc203-dc01-4e09-8716-f9c0a1b228a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:17.183790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedc203-dc01-4e09-8716-f9c0a1b228a0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:17.197710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:17.270905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d052f63-44f0-4b16-87d3-9f1900213676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:17.271508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d052f63-44f0-4b16-87d3-9f1900213676 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:17.271816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d052f63-44f0-4b16-87d3-9f1900213676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:17.272090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d052f63-44f0-4b16-87d3-9f1900213676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:17.273806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7d052f63-44f0-4b16-87d3-9f1900213676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:17.402854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d052f63-44f0-4b16-87d3-9f1900213676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:17.404405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d052f63-44f0-4b16-87d3-9f1900213676 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:17.426615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 724/1446] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:19.787353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606d5c-858b-4ab2-8b92-cf56cd8f7aa8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:19.787926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606d5c-858b-4ab2-8b92-cf56cd8f7aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:19.787926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c606d5c-858b-4ab2-8b92-cf56cd8f7aa8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:19.789289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:19.794431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af036cc-ed7a-4fd9-9668-37a739f8e516 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:19.794945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af036cc-ed7a-4fd9-9668-37a739f8e516 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:19.795091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af036cc-ed7a-4fd9-9668-37a739f8e516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:19.845729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:19.864402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2af036cc-ed7a-4fd9-9668-37a739f8e516 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:19.865627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2af036cc-ed7a-4fd9-9668-37a739f8e516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:19.964212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:20.248702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c606d5c-858b-4ab2-8b92-cf56cd8f7aa8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:20.250254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8c606d5c-858b-4ab2-8b92-cf56cd8f7aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:20.359137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c606d5c-858b-4ab2-8b92-cf56cd8f7aa8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:20.401296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:20.436420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306ff47-f988-4f14-9768-875f8698d507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:20.437115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306ff47-f988-4f14-9768-875f8698d507 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:20.437395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306ff47-f988-4f14-9768-875f8698d507 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:20.437696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306ff47-f988-4f14-9768-875f8698d507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:20.440006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5306ff47-f988-4f14-9768-875f8698d507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:20.547308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306ff47-f988-4f14-9768-875f8698d507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:20.548775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306ff47-f988-4f14-9768-875f8698d507 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:20.568385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 724/1449] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:22.656077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d694f-7197-4dfc-9d21-82afc65b0d52 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:22.656618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d694f-7197-4dfc-9d21-82afc65b0d52 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:22.656618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d694f-7197-4dfc-9d21-82afc65b0d52 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:22.657963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:22.663973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309830f-63cd-412e-9058-c9c2bb335bc5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:22.664401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309830f-63cd-412e-9058-c9c2bb335bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:22.664537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309830f-63cd-412e-9058-c9c2bb335bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:22.849319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7309830f-63cd-412e-9058-c9c2bb335bc5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:22.850436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7309830f-63cd-412e-9058-c9c2bb335bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:22.871257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:22.945929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:23.236335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d694f-7197-4dfc-9d21-82afc65b0d52 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:23.237874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-259d694f-7197-4dfc-9d21-82afc65b0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:23.344603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d694f-7197-4dfc-9d21-82afc65b0d52 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:23.364134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:23.431230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d59e5c-5c13-48d2-8a39-61d384f107a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:23.434986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59e5c-5c13-48d2-8a39-61d384f107a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:23.435515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59e5c-5c13-48d2-8a39-61d384f107a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:23.436201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d59e5c-5c13-48d2-8a39-61d384f107a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:23.445555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f4d59e5c-5c13-48d2-8a39-61d384f107a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:23.607657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d59e5c-5c13-48d2-8a39-61d384f107a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:23.609210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d59e5c-5c13-48d2-8a39-61d384f107a2 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:23.628352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 727/1452] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:25.659273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f424ae-3faa-432e-8074-d2d557edecc6 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:25.659859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f424ae-3faa-432e-8074-d2d557edecc6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:25.659859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f424ae-3faa-432e-8074-d2d557edecc6 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:25.661842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:25.667398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c80d7-a4ff-406f-8b60-d39cd407b2bf None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:25.667837 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c80d7-a4ff-406f-8b60-d39cd407b2bf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:25.667980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c80d7-a4ff-406f-8b60-d39cd407b2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:25.731276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:25.734315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b76c80d7-a4ff-406f-8b60-d39cd407b2bf None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:25.735639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b76c80d7-a4ff-406f-8b60-d39cd407b2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:25.830861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:26.112464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f424ae-3faa-432e-8074-d2d557edecc6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:26.114087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-20f424ae-3faa-432e-8074-d2d557edecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:26.217648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f424ae-3faa-432e-8074-d2d557edecc6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:26.265715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:26.291965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659bc7c-4883-46b3-b318-eeca5d235770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:26.292578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659bc7c-4883-46b3-b318-eeca5d235770 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:26.292860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659bc7c-4883-46b3-b318-eeca5d235770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:26.293130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659bc7c-4883-46b3-b318-eeca5d235770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:26.296752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4659bc7c-4883-46b3-b318-eeca5d235770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:26.403835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659bc7c-4883-46b3-b318-eeca5d235770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:26.405211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659bc7c-4883-46b3-b318-eeca5d235770 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:26.422617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 727/1455] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:28.531560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c305-f629-47f3-a958-6ef41c4b660d None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:28.532193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c305-f629-47f3-a958-6ef41c4b660d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:28.532193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c305-f629-47f3-a958-6ef41c4b660d None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:28.533494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:11:28.539655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3614-61a2-4071-a516-d5bf973800d8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:28.540209 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3614-61a2-4071-a516-d5bf973800d8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:28.540209 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3614-61a2-4071-a516-d5bf973800d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:28.610987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4d1d3614-61a2-4071-a516-d5bf973800d8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:28.612255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4d1d3614-61a2-4071-a516-d5bf973800d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:28.642159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:28.709602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:28.996523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565c305-f629-47f3-a958-6ef41c4b660d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:28.998071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0565c305-f629-47f3-a958-6ef41c4b660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:29.102531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565c305-f629-47f3-a958-6ef41c4b660d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:29.130523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:29.176066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e664839-5c0e-48fa-9126-21d385c6fadb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:29.176681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664839-5c0e-48fa-9126-21d385c6fadb service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:29.176959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664839-5c0e-48fa-9126-21d385c6fadb service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:29.177236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e664839-5c0e-48fa-9126-21d385c6fadb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:29.178843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2e664839-5c0e-48fa-9126-21d385c6fadb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:29.289800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664839-5c0e-48fa-9126-21d385c6fadb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:29.291224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e664839-5c0e-48fa-9126-21d385c6fadb service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:29.311087 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 730/1458] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:31.287705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d73bc5-1ec7-47fb-8347-b4e5273571c4 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:31.288282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d73bc5-1ec7-47fb-8347-b4e5273571c4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:31.288282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d73bc5-1ec7-47fb-8347-b4e5273571c4 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:31.289600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:31.294889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0cde-7a60-4e9f-84e6-d94b8a6cb1d6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:31.295305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0cde-7a60-4e9f-84e6-d94b8a6cb1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:31.295464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f0cde-7a60-4e9f-84e6-d94b8a6cb1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:31.363314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a99f0cde-7a60-4e9f-84e6-d94b8a6cb1d6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:31.364689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a99f0cde-7a60-4e9f-84e6-d94b8a6cb1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:31.373014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:31.463461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:31.779373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d73bc5-1ec7-47fb-8347-b4e5273571c4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:31.780992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c2d73bc5-1ec7-47fb-8347-b4e5273571c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:31.883273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d73bc5-1ec7-47fb-8347-b4e5273571c4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:31.944703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:31.972167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde3768-5a9c-4606-9bf0-18fbf249db0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:31.973718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3768-5a9c-4606-9bf0-18fbf249db0f service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:31.974587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3768-5a9c-4606-9bf0-18fbf249db0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:31.974859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde3768-5a9c-4606-9bf0-18fbf249db0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:31.976560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cbde3768-5a9c-4606-9bf0-18fbf249db0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:32.088190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde3768-5a9c-4606-9bf0-18fbf249db0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:32.089547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde3768-5a9c-4606-9bf0-18fbf249db0f service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:32.108043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 730/1461] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:11:34.279448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f334c-a177-487e-83ad-4d77c143bbd9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:34.280041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f334c-a177-487e-83ad-4d77c143bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:34.280041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f334c-a177-487e-83ad-4d77c143bbd9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:34.281376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:34.287562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969ca0-b4c7-4c24-873d-91331a72122c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:34.288096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969ca0-b4c7-4c24-873d-91331a72122c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:34.288211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969ca0-b4c7-4c24-873d-91331a72122c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:34.354447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-74969ca0-b4c7-4c24-873d-91331a72122c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:34.355580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-74969ca0-b4c7-4c24-873d-91331a72122c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:34.407440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:34.471024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:11:34.764226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f334c-a177-487e-83ad-4d77c143bbd9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:34.765972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a30f334c-a177-487e-83ad-4d77c143bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:34.875910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f334c-a177-487e-83ad-4d77c143bbd9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:34.914183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:34.950192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7a9a7-6a92-4197-8d63-a97b53e05e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:34.950801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7a9a7-6a92-4197-8d63-a97b53e05e2b service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:34.951086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7a9a7-6a92-4197-8d63-a97b53e05e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:34.951357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7a9a7-6a92-4197-8d63-a97b53e05e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:34.953002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-52a7a9a7-6a92-4197-8d63-a97b53e05e2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:35.071624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7a9a7-6a92-4197-8d63-a97b53e05e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:35.073019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7a9a7-6a92-4197-8d63-a97b53e05e2b service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:35.091736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 733/1464] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:37.050234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c0604-28a3-415c-8a3d-c07baedf3ec3 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:37.050842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c0604-28a3-415c-8a3d-c07baedf3ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:37.050842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c0604-28a3-415c-8a3d-c07baedf3ec3 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:37.052170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:11:37.057957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13eb1-eb4b-4d18-a31c-f764c4c5cc00 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:37.058412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13eb1-eb4b-4d18-a31c-f764c4c5cc00 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:37.058606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f13eb1-eb4b-4d18-a31c-f764c4c5cc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:37.126265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-06f13eb1-eb4b-4d18-a31c-f764c4c5cc00 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:37.127474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-06f13eb1-eb4b-4d18-a31c-f764c4c5cc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:37.146597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:37.237325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:37.520154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c0604-28a3-415c-8a3d-c07baedf3ec3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:37.521874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-239c0604-28a3-415c-8a3d-c07baedf3ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:37.626400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c0604-28a3-415c-8a3d-c07baedf3ec3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:37.696508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:37.704095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c45ef0-d0be-4e91-a90f-77f7cd5949e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:37.704777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45ef0-d0be-4e91-a90f-77f7cd5949e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:37.705074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45ef0-d0be-4e91-a90f-77f7cd5949e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:37.705377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c45ef0-d0be-4e91-a90f-77f7cd5949e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:37.707354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-80c45ef0-d0be-4e91-a90f-77f7cd5949e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:37.817138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c45ef0-d0be-4e91-a90f-77f7cd5949e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:37.818521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c45ef0-d0be-4e91-a90f-77f7cd5949e1 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:37.837476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 733/1467] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:39.809622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c48965-dfb0-47d6-90cb-f467122593d8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:39.810252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c48965-dfb0-47d6-90cb-f467122593d8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:39.810252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c48965-dfb0-47d6-90cb-f467122593d8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:39.811548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:11:39.816982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b987-b028-47ce-b934-51f11db436b4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:39.817468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b987-b028-47ce-b934-51f11db436b4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:39.817607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045b987-b028-47ce-b934-51f11db436b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:39.885461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b045b987-b028-47ce-b934-51f11db436b4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:11:39.886681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b045b987-b028-47ce-b934-51f11db436b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:39.935872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:39.984503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:11:40.280097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c48965-dfb0-47d6-90cb-f467122593d8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:11:40.281729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-69c48965-dfb0-47d6-90cb-f467122593d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:40.389776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c48965-dfb0-47d6-90cb-f467122593d8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:11:40.442806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:40.469997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5a281-c082-4110-9df5-cd30af8a4f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:11:40.470506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5a281-c082-4110-9df5-cd30af8a4f10 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:11:40.470786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5a281-c082-4110-9df5-cd30af8a4f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:11:40.471063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5a281-c082-4110-9df5-cd30af8a4f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:11:40.472727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-79c5a281-c082-4110-9df5-cd30af8a4f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:11:40.588142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5a281-c082-4110-9df5-cd30af8a4f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:11:40.589588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5a281-c082-4110-9df5-cd30af8a4f10 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:11:40.610040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 736/1470] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:11:49.982676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=22 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:50.607617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=66 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:00.551491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8295a-670c-43c7-acf3-a337afa9927c None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:00.552279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8295a-670c-43c7-acf3-a337afa9927c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:00.552279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8295a-670c-43c7-acf3-a337afa9927c None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:00.553422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 735/1471] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:12:00.558752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808d94b-faee-41a6-a029-5117ae5efac0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:00.559215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808d94b-faee-41a6-a029-5117ae5efac0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:00.559330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808d94b-faee-41a6-a029-5117ae5efac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:00.625903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e808d94b-faee-41a6-a029-5117ae5efac0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:12:00.626597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e808d94b-faee-41a6-a029-5117ae5efac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:00.725451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 737/1472] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:12:01.024490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454d12-1bc8-4250-baa3-82952e3c8444 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:01.024778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454d12-1bc8-4250-baa3-82952e3c8444 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:01.025047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2454d12-1bc8-4250-baa3-82952e3c8444 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:01.026381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 736/1473] 10.222.0.82 () {54 vars in 967 bytes} [Mon Aug 29 19:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:12:01.031179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c79944-621b-43ae-a90c-b5aff7cf6b94 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:01.031473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c79944-621b-43ae-a90c-b5aff7cf6b94 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:01.031787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c79944-621b-43ae-a90c-b5aff7cf6b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:01.107586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-29c79944-621b-43ae-a90c-b5aff7cf6b94 None None] MFA Rules not processed for user `5786ad6388c54a3f82955e12e8e8f8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:12:01.108832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-29c79944-621b-43ae-a90c-b5aff7cf6b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:01.129936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:01.186869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 738/1474] 10.222.0.82 () {58 vars in 1064 bytes} [Mon Aug 29 19:12:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:12:01.195173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2454d12-1bc8-4250-baa3-82952e3c8444 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:12:01.196703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c2454d12-1bc8-4250-baa3-82952e3c8444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:01.302044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2454d12-1bc8-4250-baa3-82952e3c8444 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:12:01.373615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45c9f-7106-4cb7-b422-e2cd9a7fe625 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5786ad6388c54a3f82955e12e8e8f8b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:12:01.374216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45c9f-7106-4cb7-b422-e2cd9a7fe625 service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:01.374541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45c9f-7106-4cb7-b422-e2cd9a7fe625 service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:01.374839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45c9f-7106-4cb7-b422-e2cd9a7fe625 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:01.376442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-13d45c9f-7106-4cb7-b422-e2cd9a7fe625 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:01.429884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:01.484547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d45c9f-7106-4cb7-b422-e2cd9a7fe625 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:12:01.486056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d45c9f-7106-4cb7-b422-e2cd9a7fe625 service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:12:01.504744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 737/1475] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:12:03.531744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85a13f-75f9-4f84-805b-354c83603377 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:03.532335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85a13f-75f9-4f84-805b-354c83603377 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:03.532335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd85a13f-75f9-4f84-805b-354c83603377 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:03.533666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 739/1476] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:12:03.539816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9f743-00d9-4272-96f2-a610aae1f7df None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:03.540287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9f743-00d9-4272-96f2-a610aae1f7df None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:03.540394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9f743-00d9-4272-96f2-a610aae1f7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:03.605436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-25d9f743-00d9-4272-96f2-a610aae1f7df None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:12:03.606650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-25d9f743-00d9-4272-96f2-a610aae1f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:03.700803 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 738/1477] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:12:03.984135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85a13f-75f9-4f84-805b-354c83603377 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:12:03.985679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fd85a13f-75f9-4f84-805b-354c83603377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:04.120028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd85a13f-75f9-4f84-805b-354c83603377 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:12:04.179609 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:04.226903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658d331-3991-4a23-bbdc-c8b97aaa80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:12:04.227673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658d331-3991-4a23-bbdc-c8b97aaa80d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:04.228185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658d331-3991-4a23-bbdc-c8b97aaa80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:04.228488 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658d331-3991-4a23-bbdc-c8b97aaa80d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:04.229556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658d331-3991-4a23-bbdc-c8b97aaa80d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:12:04.231309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-3658d331-3991-4a23-bbdc-c8b97aaa80d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:12:04.231309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 29 19:12:04.231309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: Aug 29 19:12:04.232505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658d331-3991-4a23-bbdc-c8b97aaa80d8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:12:04.253003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 740/1478] 10.222.0.82 () {56 vars in 1108 bytes} [Mon Aug 29 19:12:03 2022] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:12:06.194578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5e49-77f0-4e54-8c14-295c565e88fa None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:06.195132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5e49-77f0-4e54-8c14-295c565e88fa None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:06.195132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5e49-77f0-4e54-8c14-295c565e88fa None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:06.196568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 739/1479] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:12:06.202873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581973-9370-4cb4-8f0c-f9ea13e0b9d6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:06.203358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581973-9370-4cb4-8f0c-f9ea13e0b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:06.203469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581973-9370-4cb4-8f0c-f9ea13e0b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:06.269847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-93581973-9370-4cb4-8f0c-f9ea13e0b9d6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:12:06.271602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-93581973-9370-4cb4-8f0c-f9ea13e0b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:06.373337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 741/1480] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:12:06.672872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5e49-77f0-4e54-8c14-295c565e88fa None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:12:06.674521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cc4a5e49-77f0-4e54-8c14-295c565e88fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:06.685681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:06.821088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5e49-77f0-4e54-8c14-295c565e88fa None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:12:06.903512 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:06.936315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816180d1-4bb0-4173-aef4-839904e10fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:12:06.936917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816180d1-4bb0-4173-aef4-839904e10fc9 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:06.937194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816180d1-4bb0-4173-aef4-839904e10fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:06.937464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816180d1-4bb0-4173-aef4-839904e10fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:06.939106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-816180d1-4bb0-4173-aef4-839904e10fc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:07.027961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816180d1-4bb0-4173-aef4-839904e10fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:12:07.029548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816180d1-4bb0-4173-aef4-839904e10fc9 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:12:07.047967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 740/1481] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:12:09.180334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691dbf-a4d8-426e-81a3-ddababf77a38 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:09.180911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691dbf-a4d8-426e-81a3-ddababf77a38 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:09.180911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c691dbf-a4d8-426e-81a3-ddababf77a38 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:09.182253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 742/1482] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:12:09.187636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9c808-a766-41bd-af60-8ab276d84346 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:09.188094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9c808-a766-41bd-af60-8ab276d84346 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:09.188234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9c808-a766-41bd-af60-8ab276d84346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:09.252825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-aba9c808-a766-41bd-af60-8ab276d84346 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:12:09.254022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aba9c808-a766-41bd-af60-8ab276d84346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:09.298905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:09.350434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 741/1483] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:12:09.640059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c691dbf-a4d8-426e-81a3-ddababf77a38 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:12:09.641610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2c691dbf-a4d8-426e-81a3-ddababf77a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:09.665240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:09.746828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c691dbf-a4d8-426e-81a3-ddababf77a38 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:12:09.822187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef065d61-6479-48a6-aaac-d34e6b381248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:12:09.822797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef065d61-6479-48a6-aaac-d34e6b381248 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:09.823078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef065d61-6479-48a6-aaac-d34e6b381248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:09.823349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef065d61-6479-48a6-aaac-d34e6b381248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:09.824979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ef065d61-6479-48a6-aaac-d34e6b381248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:09.901361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:09.938542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef065d61-6479-48a6-aaac-d34e6b381248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:12:09.940202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef065d61-6479-48a6-aaac-d34e6b381248 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:12:09.961425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 743/1484] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:12:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:12:11.990153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9cf31-2595-4e8d-9f40-65febe2542f1 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:11.990928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9cf31-2595-4e8d-9f40-65febe2542f1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:11.990928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9cf31-2595-4e8d-9f40-65febe2542f1 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:11.992138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 742/1485] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 19:12:11.997852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83418c-5d0d-4024-8390-6b3f72bcc9a6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:11.998318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83418c-5d0d-4024-8390-6b3f72bcc9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:11.998482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83418c-5d0d-4024-8390-6b3f72bcc9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:12.067591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3c83418c-5d0d-4024-8390-6b3f72bcc9a6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:12:12.069349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3c83418c-5d0d-4024-8390-6b3f72bcc9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:12.172053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 744/1486] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:12:12.475114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9cf31-2595-4e8d-9f40-65febe2542f1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:12:12.476692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-06a9cf31-2595-4e8d-9f40-65febe2542f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:12.595545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9cf31-2595-4e8d-9f40-65febe2542f1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:12:12.675398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:12.677253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f9b39-2590-4476-8572-bdf606499f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:12:12.678373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9b39-2590-4476-8572-bdf606499f05 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:12.678650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9b39-2590-4476-8572-bdf606499f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:12.678923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f9b39-2590-4476-8572-bdf606499f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:12.680560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-410f9b39-2590-4476-8572-bdf606499f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:12.793990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f9b39-2590-4476-8572-bdf606499f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:12:12.795317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f9b39-2590-4476-8572-bdf606499f05 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:12:12.815706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 743/1487] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:12:14.956549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfd140-d207-4d6f-accc-1bac5505e381 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:14.957133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfd140-d207-4d6f-accc-1bac5505e381 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:14.957133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfd140-d207-4d6f-accc-1bac5505e381 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:14.958472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 745/1488] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:12:14.964000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899d75-8e60-41f9-8d68-ba2e0ea97ec0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:14.964428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899d75-8e60-41f9-8d68-ba2e0ea97ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:14.964571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899d75-8e60-41f9-8d68-ba2e0ea97ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:15.031068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d6899d75-8e60-41f9-8d68-ba2e0ea97ec0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:12:15.032841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d6899d75-8e60-41f9-8d68-ba2e0ea97ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:15.090720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:15.133910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 744/1489] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:12:15.434355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfd140-d207-4d6f-accc-1bac5505e381 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:12:15.435918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25cfd140-d207-4d6f-accc-1bac5505e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:15.473933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:15.542954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfd140-d207-4d6f-accc-1bac5505e381 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:12:15.624299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51263d6-8556-4918-bebe-96f46a93f364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:12:15.624905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51263d6-8556-4918-bebe-96f46a93f364 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:15.625184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51263d6-8556-4918-bebe-96f46a93f364 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:15.625456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51263d6-8556-4918-bebe-96f46a93f364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:15.627041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e51263d6-8556-4918-bebe-96f46a93f364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:15.710917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:15.740411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51263d6-8556-4918-bebe-96f46a93f364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:12:15.741830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51263d6-8556-4918-bebe-96f46a93f364 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:12:15.761169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 746/1490] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:12:18.120019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bffc74-8ee3-426a-b616-5148c61533f2 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:18.120590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bffc74-8ee3-426a-b616-5148c61533f2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:18.120590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bffc74-8ee3-426a-b616-5148c61533f2 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:18.121888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 745/1491] 10.222.0.82 () {54 vars in 927 bytes} [Mon Aug 29 19:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:12:18.127561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426c40-88c9-4f1f-a5c9-fdad161aa968 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:18.128020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426c40-88c9-4f1f-a5c9-fdad161aa968 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:18.128139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06426c40-88c9-4f1f-a5c9-fdad161aa968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:18.196385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-06426c40-88c9-4f1f-a5c9-fdad161aa968 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:12:18.197601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-06426c40-88c9-4f1f-a5c9-fdad161aa968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:18.295771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 747/1492] 10.222.0.82 () {58 vars in 1024 bytes} [Mon Aug 29 19:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:12:18.586000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bffc74-8ee3-426a-b616-5148c61533f2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:12:18.587553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-22bffc74-8ee3-426a-b616-5148c61533f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:18.696036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bffc74-8ee3-426a-b616-5148c61533f2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:12:18.773283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa34ab9-bb6c-4f6c-9059-21ff1deebd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:12:18.773889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34ab9-bb6c-4f6c-9059-21ff1deebd9d service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:12:18.774169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34ab9-bb6c-4f6c-9059-21ff1deebd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:12:18.774446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa34ab9-bb6c-4f6c-9059-21ff1deebd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:12:18.776112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7fa34ab9-bb6c-4f6c-9059-21ff1deebd9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:12:18.785115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:18.893431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa34ab9-bb6c-4f6c-9059-21ff1deebd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:12:18.894778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa34ab9-bb6c-4f6c-9059-21ff1deebd9d service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:12:18.913533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 746/1493] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:12:28.293990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=82 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:28.910636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=50 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:42.238491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07905a60-a4f5-4d4b-943d-6e8736f2cb86 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:42.239099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07905a60-a4f5-4d4b-943d-6e8736f2cb86 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:42.239099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07905a60-a4f5-4d4b-943d-6e8736f2cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:42.322452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-07905a60-a4f5-4d4b-943d-6e8736f2cb86 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:13:42.323690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-07905a60-a4f5-4d4b-943d-6e8736f2cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:42.425347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 748/1494] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:13:42.434652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1faf-2d01-411e-a7a6-a86817c84cb2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:42.438394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1faf-2d01-411e-a7a6-a86817c84cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:42.438394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b1faf-2d01-411e-a7a6-a86817c84cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:42.512416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e55b1faf-2d01-411e-a7a6-a86817c84cb2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:13:42.513627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e55b1faf-2d01-411e-a7a6-a86817c84cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:42.611450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 747/1495] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:13:42.616826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07905a60-a4f5-4d4b-943d-6e8736f2cb86 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:42.618071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-07905a60-a4f5-4d4b-943d-6e8736f2cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:42.629830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07905a60-a4f5-4d4b-943d-6e8736f2cb86 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:42.694495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:42.731124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:42.731756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:42.732048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:42.732326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:42.732980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:13:42.733288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:42.734353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:13:42.734353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 29 19:13:42.734353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: Aug 29 19:13:42.735339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:42.755050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 749/1496] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:13:42.756236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b1faf-2d01-411e-a7a6-a86817c84cb2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:42.769658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b1faf-2d01-411e-a7a6-a86817c84cb2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:42.830970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:42.866210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:42.866784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:42.867066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:42.867340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:42.868063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:42.869787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING py.warnings [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:13:42.869787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: warnings.warn(msg) Aug 29 19:13:42.869787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: Aug 29 19:13:42.871004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:42.974635 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 748/1497] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:13:42 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:13:42.979471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:42.981161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:43.015833 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acca39-9d9d-4570-bed0-15e53578bcf2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:43.112944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:43.113464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:43.113746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:43.114020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:43.114658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:43.115989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:13:43.115989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 29 19:13:43.115989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: Aug 29 19:13:43.117223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:43.219953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 750/1498] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:13:42 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:13:43.227202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:43.228784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:43.295296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07955-f759-418d-80a6-49b82d4f3c0c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:43.380086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:43.391836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:43.392519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:43.392805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:43.393084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:43.393730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:43.394738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING py.warnings [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:13:43.394738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: warnings.warn(msg) Aug 29 19:13:43.394738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: Aug 29 19:13:43.395624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:43.408982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 749/1499] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:13:43.413720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:43.415321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:43.426946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f2cbe-0ee7-4c60-9ece-ad1828ef9154 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:43.454381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:43.528611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66d6bf-9d36-4cac-be38-13d985f1d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:43.529214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66d6bf-9d36-4cac-be38-13d985f1d22d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:43.529495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66d6bf-9d36-4cac-be38-13d985f1d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:43.529767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66d6bf-9d36-4cac-be38-13d985f1d22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:43.530406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66d6bf-9d36-4cac-be38-13d985f1d22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:43.531423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-af66d6bf-9d36-4cac-be38-13d985f1d22d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:13:43.531423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 29 19:13:43.531423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: Aug 29 19:13:43.532355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66d6bf-9d36-4cac-be38-13d985f1d22d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:43.545407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 751/1500] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:13:43.549677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:43.551239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:43.586210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9f766-498b-4005-a695-15e7bb6bef38 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:43.681359 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9701c-29c8-44c7-8c49-1bc8c2c012e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:43.681933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9701c-29c8-44c7-8c49-1bc8c2c012e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:43.682218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9701c-29c8-44c7-8c49-1bc8c2c012e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:43.682490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9701c-29c8-44c7-8c49-1bc8c2c012e2 admin admin] PATH_INFO: `/v3/projects/f62d1d785ec2418fbaf815cc1132349b/users/5a049c553c774fd2a17f7f9ea705b896/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:43.706649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9701c-29c8-44c7-8c49-1bc8c2c012e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62d1d785ec2418fbaf815cc1132349b, user_id=5a049c553c774fd2a17f7f9ea705b896, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:43.707681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING py.warnings [None req-04e9701c-29c8-44c7-8c49-1bc8c2c012e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:13:43.707681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: warnings.warn(msg) Aug 29 19:13:43.707681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: Aug 29 19:13:43.709734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e9701c-29c8-44c7-8c49-1bc8c2c012e2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:43.789845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 750/1501] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:13:43 2022] PUT /identity/v3/projects/f62d1d785ec2418fbaf815cc1132349b/users/5a049c553c774fd2a17f7f9ea705b896/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:13:43.802211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdcafb-fdfa-464b-ac27-c9eae3cb6c66 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:43.802530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdcafb-fdfa-464b-ac27-c9eae3cb6c66 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:43.802811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfdcafb-fdfa-464b-ac27-c9eae3cb6c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:43.862268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8bfdcafb-fdfa-464b-ac27-c9eae3cb6c66 None None] MFA Rules not processed for user `5a049c553c774fd2a17f7f9ea705b896`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:13:43.863486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8bfdcafb-fdfa-464b-ac27-c9eae3cb6c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:43.944968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 752/1502] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:13:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:13:43.958312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45a69-2f5c-487d-b335-05a34fa477ca None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:43.958604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45a69-2f5c-487d-b335-05a34fa477ca None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:43.958884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e45a69-2f5c-487d-b335-05a34fa477ca None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:43.960976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 751/1503] 10.222.0.82 () {54 vars in 964 bytes} [Mon Aug 29 19:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:13:43.966098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0a24-6bb2-48fe-b076-f3553ea94833 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:43.966505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0a24-6bb2-48fe-b076-f3553ea94833 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:43.966824 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e0a24-6bb2-48fe-b076-f3553ea94833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:43.999502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:44.044472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a00e0a24-6bb2-48fe-b076-f3553ea94833 None None] MFA Rules not processed for user `1b55bbe406a04cf28244380f5b07eed9`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:13:44.045808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a00e0a24-6bb2-48fe-b076-f3553ea94833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:44.125074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 753/1504] 10.222.0.82 () {58 vars in 1061 bytes} [Mon Aug 29 19:13:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:13:44.133715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e45a69-2f5c-487d-b335-05a34fa477ca None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:44.135248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c5e45a69-2f5c-487d-b335-05a34fa477ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:44.188846 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:44.245547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e45a69-2f5c-487d-b335-05a34fa477ca None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:44.322672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:44.323410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:44.323702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:44.324015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:44.325671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:44.429766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:44.431204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:44.441558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:44.450710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 752/1505] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:13:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:13:44.496949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ac9e-298b-422c-8ad8-76c754f1ced9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:44.497380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ac9e-298b-422c-8ad8-76c754f1ced9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:44.497623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727ac9e-298b-422c-8ad8-76c754f1ced9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:44.498891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 754/1506] 10.222.0.82 () {52 vars in 830 bytes} [Mon Aug 29 19:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:13:44.502411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:44.503623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:44.608122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053f73-a63c-498e-838c-c34edc5024b9 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:44.701774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:44.702418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:44.702701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:44.702971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] PATH_INFO: `/v3/users/5a049c553c774fd2a17f7f9ea705b896` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:44.715400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a049c553c774fd2a17f7f9ea705b896)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:44.716384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING py.warnings [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:13:44.716384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: warnings.warn(msg) Aug 29 19:13:44.716384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: Aug 29 19:13:44.717599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:44.728259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:44.987743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a049c553c774fd2a17f7f9ea705b896'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:44.988085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a049c553c774fd2a17f7f9ea705b896'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:45.068481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a049c553c774fd2a17f7f9ea705b896'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:45.069070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a049c553c774fd2a17f7f9ea705b896'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:45.094627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a049c553c774fd2a17f7f9ea705b896'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:45.115016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 753/1507] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:13:44 2022] DELETE /identity/v3/users/5a049c553c774fd2a17f7f9ea705b896 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:13:45.120088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ba2fe-924c-49a5-b719-d7c8408bd9f9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:45.120386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ba2fe-924c-49a5-b719-d7c8408bd9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:45.120670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ba2fe-924c-49a5-b719-d7c8408bd9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:45.179435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e51ba2fe-924c-49a5-b719-d7c8408bd9f9 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:13:45.180704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e51ba2fe-924c-49a5-b719-d7c8408bd9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:45.258212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:45.270541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 755/1508] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:13:45.280847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:45.282081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:45.386701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9093772-cd35-44f7-af35-62bf27a88f3c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:45.446096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:45.467266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91273c23-63ef-4d05-babb-8c684249a58a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:45.467916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273c23-63ef-4d05-babb-8c684249a58a service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:45.468201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273c23-63ef-4d05-babb-8c684249a58a service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:45.468476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91273c23-63ef-4d05-babb-8c684249a58a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:45.470077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-91273c23-63ef-4d05-babb-8c684249a58a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:45.581889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91273c23-63ef-4d05-babb-8c684249a58a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:45.583243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91273c23-63ef-4d05-babb-8c684249a58a service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:45.605003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 754/1509] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:13:46.117472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ba2fe-924c-49a5-b719-d7c8408bd9f9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:13:46.118827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e51ba2fe-924c-49a5-b719-d7c8408bd9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:13:46.130679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ba2fe-924c-49a5-b719-d7c8408bd9f9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:13:46.234267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:13:46.234918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:13:46.235198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:13:46.235481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] PATH_INFO: `/v3/projects/f62d1d785ec2418fbaf815cc1132349b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:13:46.246946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62d1d785ec2418fbaf815cc1132349b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:13:46.248008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:13:46.248008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 29 19:13:46.248008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: Aug 29 19:13:46.249251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:13:46.399793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62d1d785ec2418fbaf815cc1132349b', 'request_id': 'req-89959f3a-ab54-4420-baa3-a8e2728c532b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:46.497371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62d1d785ec2418fbaf815cc1132349b', 'request_id': 'req-89959f3a-ab54-4420-baa3-a8e2728c532b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:46.512082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62d1d785ec2418fbaf815cc1132349b', 'request_id': 'req-89959f3a-ab54-4420-baa3-a8e2728c532b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:46.534679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] The token cache is being invalidate because project f62d1d785ec2418fbaf815cc1132349b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:13:46.534964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:46.535387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-89959f3a-ab54-4420-baa3-a8e2728c532b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:13:46.536905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 756/1510] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:13:46 2022] DELETE /identity/v3/projects/f62d1d785ec2418fbaf815cc1132349b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:13:55.602476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=62 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:56.532594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:32.392940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6882-eb38-474a-8eaf-efac28d1f982 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:32.393549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6882-eb38-474a-8eaf-efac28d1f982 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:32.393549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6882-eb38-474a-8eaf-efac28d1f982 None None] PATH_INFO: `/v3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:32.394965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 755/1511] 10.222.0.78 () {54 vars in 925 bytes} [Mon Aug 29 19:15:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:15:32.405537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38316-6d5d-469a-8239-205ab981409f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:32.406376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38316-6d5d-469a-8239-205ab981409f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:32.406376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd38316-6d5d-469a-8239-205ab981409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:32.496238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ebd38316-6d5d-469a-8239-205ab981409f None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:32.497390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ebd38316-6d5d-469a-8239-205ab981409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:32.634995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 757/1512] 10.222.0.78 () {58 vars in 1015 bytes} [Mon Aug 29 19:15:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:33.329539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c593d3f-061b-47cf-907b-c10d2791177f None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:33.329829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c593d3f-061b-47cf-907b-c10d2791177f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:33.330113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c593d3f-061b-47cf-907b-c10d2791177f None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:33.331634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 756/1513] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:33.336782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9a257-3ed1-4cac-bd6f-ca15f594943e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:33.337061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9a257-3ed1-4cac-bd6f-ca15f594943e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:33.337338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9a257-3ed1-4cac-bd6f-ca15f594943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:33.398591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-30c9a257-3ed1-4cac-bd6f-ca15f594943e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:33.399853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-30c9a257-3ed1-4cac-bd6f-ca15f594943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:33.419657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:33.482044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 758/1514] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:33.645968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c593d3f-061b-47cf-907b-c10d2791177f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:33.648144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7c593d3f-061b-47cf-907b-c10d2791177f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:33.757704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c593d3f-061b-47cf-907b-c10d2791177f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:33.763220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f9acf-1d8a-4e3a-8f69-2b80363963af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:33.763910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9acf-1d8a-4e3a-8f69-2b80363963af service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:33.764195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9acf-1d8a-4e3a-8f69-2b80363963af service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:33.765283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9acf-1d8a-4e3a-8f69-2b80363963af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:33.775275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f9acf-1d8a-4e3a-8f69-2b80363963af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:33.776961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f9acf-1d8a-4e3a-8f69-2b80363963af service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:33.787217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 757/1515] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:34.777918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea6f0-7e44-4fb1-ba9f-df7bda092dc8 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:34.778490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea6f0-7e44-4fb1-ba9f-df7bda092dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:34.778811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ea6f0-7e44-4fb1-ba9f-df7bda092dc8 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:34.780485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 759/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:34.785984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd0f0-e028-42fc-9b1c-148ab5e575b8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:34.786505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd0f0-e028-42fc-9b1c-148ab5e575b8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:34.786629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cd0f0-e028-42fc-9b1c-148ab5e575b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:34.810662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-946cd0f0-e028-42fc-9b1c-148ab5e575b8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:34.812503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-946cd0f0-e028-42fc-9b1c-148ab5e575b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:34.820527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 758/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:34.990693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ea6f0-7e44-4fb1-ba9f-df7bda092dc8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:35.009757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ea6f0-7e44-4fb1-ba9f-df7bda092dc8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:35.016330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f27185-ed70-42a3-9090-1d35e2c596de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:35.017035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27185-ed70-42a3-9090-1d35e2c596de service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:35.017325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27185-ed70-42a3-9090-1d35e2c596de service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:35.017614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f27185-ed70-42a3-9090-1d35e2c596de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:35.029699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f27185-ed70-42a3-9090-1d35e2c596de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:35.031578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f27185-ed70-42a3-9090-1d35e2c596de service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:35.044136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 760/1518] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:42.670489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3e26-bbc4-4d1f-a6b2-a0bcadefebac None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:42.671081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3e26-bbc4-4d1f-a6b2-a0bcadefebac None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:42.671188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df3e26-bbc4-4d1f-a6b2-a0bcadefebac None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:42.672667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 759/1519] 10.222.0.82 () {54 vars in 961 bytes} [Mon Aug 29 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:42.677967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72888da-0baf-4f50-916a-36d967461c0b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:42.678477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72888da-0baf-4f50-916a-36d967461c0b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:42.678579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72888da-0baf-4f50-916a-36d967461c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:42.699162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b72888da-0baf-4f50-916a-36d967461c0b None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:42.700438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b72888da-0baf-4f50-916a-36d967461c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:42.710301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 761/1520] 10.222.0.82 () {58 vars in 1058 bytes} [Mon Aug 29 19:15:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:42.717729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df3e26-bbc4-4d1f-a6b2-a0bcadefebac None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:42.737922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df3e26-bbc4-4d1f-a6b2-a0bcadefebac None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:42.743915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc000c6-70bc-405c-982a-4332a5639a35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf58a62bd2e4139965fc25a4f9c6161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:42.744380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc000c6-70bc-405c-982a-4332a5639a35 service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:42.744840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc000c6-70bc-405c-982a-4332a5639a35 service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:42.745115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc000c6-70bc-405c-982a-4332a5639a35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:42.755936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc000c6-70bc-405c-982a-4332a5639a35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:42.758990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc000c6-70bc-405c-982a-4332a5639a35 service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:42.773665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 760/1521] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:46.298841 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd39e7-36a0-4026-b248-e8cb22b2d693 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:46.299405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd39e7-36a0-4026-b248-e8cb22b2d693 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:46.299405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd39e7-36a0-4026-b248-e8cb22b2d693 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:46.300764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:46.305604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8d37-7fab-4c81-aafe-6fabdeb14e87 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:46.306006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8d37-7fab-4c81-aafe-6fabdeb14e87 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:46.306158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd8d37-7fab-4c81-aafe-6fabdeb14e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:46.326766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-72dd8d37-7fab-4c81-aafe-6fabdeb14e87 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:46.328078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-72dd8d37-7fab-4c81-aafe-6fabdeb14e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:46.336330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:46.502395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd39e7-36a0-4026-b248-e8cb22b2d693 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:46.517368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd39e7-36a0-4026-b248-e8cb22b2d693 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:46.522744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894eba-c6d8-427e-acd1-167c299f70e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:46.523341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894eba-c6d8-427e-acd1-167c299f70e6 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:46.523623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894eba-c6d8-427e-acd1-167c299f70e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:46.523927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894eba-c6d8-427e-acd1-167c299f70e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:46.533631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a894eba-c6d8-427e-acd1-167c299f70e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:46.535219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a894eba-c6d8-427e-acd1-167c299f70e6 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:46.544773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 763/1524] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:47.424008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99dfe5-6d91-4650-8954-a6ba9031a6cd None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:47.424569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99dfe5-6d91-4650-8954-a6ba9031a6cd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:47.424569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99dfe5-6d91-4650-8954-a6ba9031a6cd None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:47.425971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 19:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:47.430963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc858b-4e3c-4609-9195-fe070d9ce6c6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:47.431406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc858b-4e3c-4609-9195-fe070d9ce6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:47.431544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc858b-4e3c-4609-9195-fe070d9ce6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:47.451542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-07fc858b-4e3c-4609-9195-fe070d9ce6c6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:47.456232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-07fc858b-4e3c-4609-9195-fe070d9ce6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:47.461541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 19:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:47.620465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99dfe5-6d91-4650-8954-a6ba9031a6cd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:47.636201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99dfe5-6d91-4650-8954-a6ba9031a6cd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:47.642078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c3496-4a41-4576-a544-3e2c96519633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:47.642677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c3496-4a41-4576-a544-3e2c96519633 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:47.642960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c3496-4a41-4576-a544-3e2c96519633 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:47.643293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c3496-4a41-4576-a544-3e2c96519633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:47.651630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c3496-4a41-4576-a544-3e2c96519633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:47.653231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c3496-4a41-4576-a544-3e2c96519633 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:47.662847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 763/1527] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:51.585693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f69544-69c0-49d2-867d-5ef00c706fe7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:51.586229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f69544-69c0-49d2-867d-5ef00c706fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:51.586229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f69544-69c0-49d2-867d-5ef00c706fe7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:51.587622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:51.592944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0e64-aa2f-4241-ba9e-970f26c1a8a7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:51.593377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0e64-aa2f-4241-ba9e-970f26c1a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:51.593578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f0e64-aa2f-4241-ba9e-970f26c1a8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:51.614312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ef4f0e64-aa2f-4241-ba9e-970f26c1a8a7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:51.615567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ef4f0e64-aa2f-4241-ba9e-970f26c1a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:51.623474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:51.927238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f69544-69c0-49d2-867d-5ef00c706fe7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:51.929068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c2f69544-69c0-49d2-867d-5ef00c706fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:52.010554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f69544-69c0-49d2-867d-5ef00c706fe7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:52.014334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16767cb-e64f-4e2d-9749-53c9f05bfbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:52.014943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16767cb-e64f-4e2d-9749-53c9f05bfbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:52.015742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16767cb-e64f-4e2d-9749-53c9f05bfbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:52.016079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16767cb-e64f-4e2d-9749-53c9f05bfbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:52.026169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16767cb-e64f-4e2d-9749-53c9f05bfbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:52.027713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16767cb-e64f-4e2d-9749-53c9f05bfbc0 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:52.039355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 766/1530] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:54.016786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbba3d-9d5c-4659-be44-79afc690ce81 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:54.017357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbba3d-9d5c-4659-be44-79afc690ce81 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:54.017357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbba3d-9d5c-4659-be44-79afc690ce81 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:54.018648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:54.024185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5e0d2-dd50-443d-a8d1-3d9b4f047cbc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:54.024638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5e0d2-dd50-443d-a8d1-3d9b4f047cbc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:54.024748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5e0d2-dd50-443d-a8d1-3d9b4f047cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:54.045079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-70e5e0d2-dd50-443d-a8d1-3d9b4f047cbc None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:54.046314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-70e5e0d2-dd50-443d-a8d1-3d9b4f047cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:54.054510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:54.349534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbba3d-9d5c-4659-be44-79afc690ce81 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:54.351936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4fdbba3d-9d5c-4659-be44-79afc690ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:54.366343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbba3d-9d5c-4659-be44-79afc690ce81 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:54.369795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1b57c-d9be-47c7-99d6-642c716b4e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:54.370397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1b57c-d9be-47c7-99d6-642c716b4e15 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:54.370677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1b57c-d9be-47c7-99d6-642c716b4e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:54.370947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1b57c-d9be-47c7-99d6-642c716b4e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:54.382737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1b57c-d9be-47c7-99d6-642c716b4e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:54.384313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1b57c-d9be-47c7-99d6-642c716b4e15 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:54.394440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 766/1533] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:15:57.922366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d218-16fb-49c3-8a18-48e6c2d58130 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:57.922949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d218-16fb-49c3-8a18-48e6c2d58130 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:57.922949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d218-16fb-49c3-8a18-48e6c2d58130 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:57.925032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:15:57.931135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50c78f-f1b5-43cf-a31f-28e0947e5efc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:57.932321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50c78f-f1b5-43cf-a31f-28e0947e5efc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:57.932321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e50c78f-f1b5-43cf-a31f-28e0947e5efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:57.940129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=74 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:57.952321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1e50c78f-f1b5-43cf-a31f-28e0947e5efc None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:15:57.953692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1e50c78f-f1b5-43cf-a31f-28e0947e5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:57.961608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:15:58.533634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d218-16fb-49c3-8a18-48e6c2d58130 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:15:58.536115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8f57d218-16fb-49c3-8a18-48e6c2d58130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:15:58.585982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:58.627938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d218-16fb-49c3-8a18-48e6c2d58130 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:15:58.631927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d571191-b3f9-477a-8cc6-406947da2400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:15:58.632548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d571191-b3f9-477a-8cc6-406947da2400 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:15:58.632831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d571191-b3f9-477a-8cc6-406947da2400 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:15:58.633106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d571191-b3f9-477a-8cc6-406947da2400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:15:58.643127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d571191-b3f9-477a-8cc6-406947da2400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:15:58.644614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d571191-b3f9-477a-8cc6-406947da2400 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:15:58.654606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 769/1536] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:00.642348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ee0a-a1db-43b3-8e40-cde4253ce4c8 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:00.642936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ee0a-a1db-43b3-8e40-cde4253ce4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:00.642936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ee0a-a1db-43b3-8e40-cde4253ce4c8 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:00.644377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 19:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:16:00.650140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eea0-95e9-40f8-839e-03626d2a96d7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:00.650577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eea0-95e9-40f8-839e-03626d2a96d7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:00.650768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571eea0-95e9-40f8-839e-03626d2a96d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:00.672038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d571eea0-95e9-40f8-839e-03626d2a96d7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:16:00.673259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d571eea0-95e9-40f8-839e-03626d2a96d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:00.681073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 19:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:16:01.238693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96ee0a-a1db-43b3-8e40-cde4253ce4c8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:16:01.240480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ab96ee0a-a1db-43b3-8e40-cde4253ce4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:16:01.253773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96ee0a-a1db-43b3-8e40-cde4253ce4c8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:16:01.257316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736d287-5de1-4e64-a619-14465f6703fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:16:01.257915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d287-5de1-4e64-a619-14465f6703fa service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:16:01.258196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d287-5de1-4e64-a619-14465f6703fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:16:01.258470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736d287-5de1-4e64-a619-14465f6703fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:16:01.268096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736d287-5de1-4e64-a619-14465f6703fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:16:01.269573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736d287-5de1-4e64-a619-14465f6703fa service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:16:01.278976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 769/1539] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:16:10.666533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=18 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:11.274851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=8 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:31.977462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43271f-bc21-47fa-9393-97cd567890e4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:31.978484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43271f-bc21-47fa-9393-97cd567890e4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:31.978484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43271f-bc21-47fa-9393-97cd567890e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.012483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7b43271f-bc21-47fa-9393-97cd567890e4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:32.013996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7b43271f-bc21-47fa-9393-97cd567890e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:32.029012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 771/1540] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:32.040224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e293b24-2116-420b-b740-bebce15abec0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.041161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e293b24-2116-420b-b740-bebce15abec0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.041161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e293b24-2116-420b-b740-bebce15abec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.078746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2e293b24-2116-420b-b740-bebce15abec0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:32.080024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2e293b24-2116-420b-b740-bebce15abec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:32.095653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 770/1541] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:17:32.101865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43271f-bc21-47fa-9393-97cd567890e4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:32.113022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43271f-bc21-47fa-9393-97cd567890e4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:32.128792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:32.130779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.131154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.131536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.132240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:32.132769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:32.134495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:32.153646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 772/1542] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:32.162945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e293b24-2116-420b-b740-bebce15abec0 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:32.189295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e293b24-2116-420b-b740-bebce15abec0 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:32.213195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a812a2-4965-487d-91fc-baaf24c24ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:32.214190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a812a2-4965-487d-91fc-baaf24c24ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.214900 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a812a2-4965-487d-91fc-baaf24c24ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.215392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a812a2-4965-487d-91fc-baaf24c24ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.216616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a812a2-4965-487d-91fc-baaf24c24ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:32.223902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a812a2-4965-487d-91fc-baaf24c24ffa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:32.432796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 771/1543] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:32 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:17:32.439812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:32.462560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94796451-c1be-44f1-b5a7-0bad256075a3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:32.478297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689934-7a5b-4cbd-a057-7e3c0a085cbd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.492997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689934-7a5b-4cbd-a057-7e3c0a085cbd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.492997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86689934-7a5b-4cbd-a057-7e3c0a085cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.550659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-86689934-7a5b-4cbd-a057-7e3c0a085cbd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:32.553893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-86689934-7a5b-4cbd-a057-7e3c0a085cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:32.596124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60517-a13e-4d9a-9670-b0d01b33fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:32.596793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60517-a13e-4d9a-9670-b0d01b33fa8a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.597092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60517-a13e-4d9a-9670-b0d01b33fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.597384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60517-a13e-4d9a-9670-b0d01b33fa8a admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.598918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a60517-a13e-4d9a-9670-b0d01b33fa8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:32.605819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a60517-a13e-4d9a-9670-b0d01b33fa8a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:32.747474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 772/1544] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:17:32.750260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d18ba-cfb8-49d2-b2eb-3381c6bc2ae8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.756047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d18ba-cfb8-49d2-b2eb-3381c6bc2ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.756047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d18ba-cfb8-49d2-b2eb-3381c6bc2ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.778965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 773/1545] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:32 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:32.791419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6787bd-d337-4909-9095-a4a254d920c3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.791419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6787bd-d337-4909-9095-a4a254d920c3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.791419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6787bd-d337-4909-9095-a4a254d920c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.804049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-912d18ba-cfb8-49d2-b2eb-3381c6bc2ae8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:32.806167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-912d18ba-cfb8-49d2-b2eb-3381c6bc2ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:32.842236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 773/1546] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:32.846027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d18ba-cfb8-49d2-b2eb-3381c6bc2ae8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:32.885187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d18ba-cfb8-49d2-b2eb-3381c6bc2ae8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:32.888342 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cd6787bd-d337-4909-9095-a4a254d920c3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:32.890573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cd6787bd-d337-4909-9095-a4a254d920c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:32.899058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75670db-b4b7-43de-8376-8a6ccedd3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:32.900121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75670db-b4b7-43de-8376-8a6ccedd3331 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.900612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75670db-b4b7-43de-8376-8a6ccedd3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.901079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75670db-b4b7-43de-8376-8a6ccedd3331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.902243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75670db-b4b7-43de-8376-8a6ccedd3331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:32.905467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75670db-b4b7-43de-8376-8a6ccedd3331 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:32.928327 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 774/1547] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:32.930576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3bf06-925d-4d75-8461-4a29ebf57125 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:32.931084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3bf06-925d-4d75-8461-4a29ebf57125 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:32.931587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3bf06-925d-4d75-8461-4a29ebf57125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:32.953223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 774/1548] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:32.955451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75670db-b4b7-43de-8376-8a6ccedd3331 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:32.992337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75670db-b4b7-43de-8376-8a6ccedd3331 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:33.006056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7ed3bf06-925d-4d75-8461-4a29ebf57125 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:33.008505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7ed3bf06-925d-4d75-8461-4a29ebf57125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:33.010610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:33.011748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.012250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.012738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.013886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:33.014510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:33.016460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING py.warnings [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:17:33.016460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: warnings.warn(msg) Aug 29 19:17:33.016460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: Aug 29 19:17:33.018089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:33.058696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 775/1549] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:33.060260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3bf06-925d-4d75-8461-4a29ebf57125 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:33.062487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 775/1550] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:33.069351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:33.088914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3bf06-925d-4d75-8461-4a29ebf57125 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:33.112693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd859-4908-4814-b56a-45ef5058eb99 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:33.114960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7ce5-52ea-4b44-ad3e-28980c288117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:33.116042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7ce5-52ea-4b44-ad3e-28980c288117 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.116537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7ce5-52ea-4b44-ad3e-28980c288117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.117035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7ce5-52ea-4b44-ad3e-28980c288117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.118353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7ce5-52ea-4b44-ad3e-28980c288117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:33.121694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7ce5-52ea-4b44-ad3e-28980c288117 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:33.144369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:33.145435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.145994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.146521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.157261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:33.157826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:33.161124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:33.167366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 776/1551] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:33.173925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7ce5-52ea-4b44-ad3e-28980c288117 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:33.197048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 776/1552] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:33.199918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:33.211245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7ce5-52ea-4b44-ad3e-28980c288117 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:33.237207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59b823-6998-4c3f-8adf-696c13eab27b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:33.240548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:33.241788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.242293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.242920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.244560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:33.246479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:17:33.246479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 29 19:17:33.246479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: Aug 29 19:17:33.248905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:33.258435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f8c53-02ad-4235-a9b4-b8efa81bd073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:33.259886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8c53-02ad-4235-a9b4-b8efa81bd073 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.260541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8c53-02ad-4235-a9b4-b8efa81bd073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.261240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f8c53-02ad-4235-a9b4-b8efa81bd073 admin admin] PATH_INFO: `/v3/projects/e2f9dec4cea242238a31f2fab8075032/users/43b97865b5a4406a9639a3ace6daac8d/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.317183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8c53-02ad-4235-a9b4-b8efa81bd073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2f9dec4cea242238a31f2fab8075032, user_id=43b97865b5a4406a9639a3ace6daac8d, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:33.325046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f8c53-02ad-4235-a9b4-b8efa81bd073 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:33.496521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 777/1553] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:33 2022] POST /identity/v3/projects => generated 391 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:33.498013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:33.545728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 777/1554] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:33 2022] PUT /identity/v3/projects/e2f9dec4cea242238a31f2fab8075032/users/43b97865b5a4406a9639a3ace6daac8d/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:33.545728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e341e-d494-49c2-b1f4-184c493a4bf6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.545728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e341e-d494-49c2-b1f4-184c493a4bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.545728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e341e-d494-49c2-b1f4-184c493a4bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.589947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b20e341e-d494-49c2-b1f4-184c493a4bf6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:33.591178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b20e341e-d494-49c2-b1f4-184c493a4bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:33.630275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305db92-19a5-4caf-bafe-5fe71a2a516d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:33.699229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:33.720870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:33.742311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 778/1555] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:33.744141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124af0a-b89e-473a-8efd-8b3ee15d942e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.744502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124af0a-b89e-473a-8efd-8b3ee15d942e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.744916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124af0a-b89e-473a-8efd-8b3ee15d942e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.765291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c065e8-ed44-4dee-afc2-6dec25a54e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:33.766710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c065e8-ed44-4dee-afc2-6dec25a54e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.767259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c065e8-ed44-4dee-afc2-6dec25a54e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.767847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c065e8-ed44-4dee-afc2-6dec25a54e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.770627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c065e8-ed44-4dee-afc2-6dec25a54e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:33.773405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c065e8-ed44-4dee-afc2-6dec25a54e9e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:33.782489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3124af0a-b89e-473a-8efd-8b3ee15d942e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:33.782489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3124af0a-b89e-473a-8efd-8b3ee15d942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:33.796174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 779/1556] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:33.797197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124af0a-b89e-473a-8efd-8b3ee15d942e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:33.808628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124af0a-b89e-473a-8efd-8b3ee15d942e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:33.813918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c2e78-a6b6-4d89-81bc-bc8e675e0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:33.814591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2e78-a6b6-4d89-81bc-bc8e675e0900 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.814905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2e78-a6b6-4d89-81bc-bc8e675e0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.815234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c2e78-a6b6-4d89-81bc-bc8e675e0900 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.815933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c2e78-a6b6-4d89-81bc-bc8e675e0900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:33.817037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING py.warnings [None req-424c2e78-a6b6-4d89-81bc-bc8e675e0900 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:17:33.817037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: warnings.warn(msg) Aug 29 19:17:33.817037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: Aug 29 19:17:33.818313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c2e78-a6b6-4d89-81bc-bc8e675e0900 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:33.959448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 778/1557] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:33 2022] POST /identity/v3/projects => generated 375 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:33.963892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1a47-013f-4c2f-954b-3bff8d6047ab None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:33.964185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1a47-013f-4c2f-954b-3bff8d6047ab None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:33.964464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f1a47-013f-4c2f-954b-3bff8d6047ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:33.992983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5f3f1a47-013f-4c2f-954b-3bff8d6047ab None None] MFA Rules not processed for user `43b97865b5a4406a9639a3ace6daac8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:33.994503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5f3f1a47-013f-4c2f-954b-3bff8d6047ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.002270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 780/1558] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:33 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:34.003326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec0b2f-8b8c-4051-93d4-b84a248873f8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.011385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec0b2f-8b8c-4051-93d4-b84a248873f8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.011385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec0b2f-8b8c-4051-93d4-b84a248873f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.028489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-53ec0b2f-8b8c-4051-93d4-b84a248873f8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.029720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-53ec0b2f-8b8c-4051-93d4-b84a248873f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.081320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 779/1559] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.082610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1a998-2918-4647-b45b-cf0ac5c9ff1f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.083384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1a998-2918-4647-b45b-cf0ac5c9ff1f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.083658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1a998-2918-4647-b45b-cf0ac5c9ff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.111813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 781/1560] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.111813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d0386-fc2d-4c51-954a-0f988f413cee None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.112451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7ca1a998-2918-4647-b45b-cf0ac5c9ff1f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.112571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d0386-fc2d-4c51-954a-0f988f413cee None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.112571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d0386-fc2d-4c51-954a-0f988f413cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.112765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7ca1a998-2918-4647-b45b-cf0ac5c9ff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.123862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 780/1561] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.135052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046926b1-ba71-43f5-bb2a-83a330bf3b33 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.135052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046926b1-ba71-43f5-bb2a-83a330bf3b33 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.135052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046926b1-ba71-43f5-bb2a-83a330bf3b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.136775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e29d0386-fc2d-4c51-954a-0f988f413cee None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.138131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e29d0386-fc2d-4c51-954a-0f988f413cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.149152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 782/1562] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.149943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d0386-fc2d-4c51-954a-0f988f413cee None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.157162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-046926b1-ba71-43f5-bb2a-83a330bf3b33 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.158427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-046926b1-ba71-43f5-bb2a-83a330bf3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.160068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d0386-fc2d-4c51-954a-0f988f413cee None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.165669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124433b-27ef-4376-94f6-8ff982c14baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.166414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124433b-27ef-4376-94f6-8ff982c14baf admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.166700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124433b-27ef-4376-94f6-8ff982c14baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.166978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124433b-27ef-4376-94f6-8ff982c14baf admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.171288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124433b-27ef-4376-94f6-8ff982c14baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.171527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 781/1563] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.171527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046926b1-ba71-43f5-bb2a-83a330bf3b33 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.171696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124433b-27ef-4376-94f6-8ff982c14baf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.186159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046926b1-ba71-43f5-bb2a-83a330bf3b33 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.191411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53b4e3-2604-495c-b708-6481936002ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.200559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53b4e3-2604-495c-b708-6481936002ec admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.200559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53b4e3-2604-495c-b708-6481936002ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.200559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53b4e3-2604-495c-b708-6481936002ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.200559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53b4e3-2604-495c-b708-6481936002ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.200559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53b4e3-2604-495c-b708-6481936002ec admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.209060 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 782/1564] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:34.210352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65e330-3ffe-4932-8962-b3b6e20681dd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.210640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65e330-3ffe-4932-8962-b3b6e20681dd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.210929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65e330-3ffe-4932-8962-b3b6e20681dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.234683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3d65e330-3ffe-4932-8962-b3b6e20681dd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.251491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3d65e330-3ffe-4932-8962-b3b6e20681dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.251491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 783/1565] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.251491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbcdb3-0415-4951-aba2-3c52d68c3f43 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.251491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbcdb3-0415-4951-aba2-3c52d68c3f43 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.251491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbcdb3-0415-4951-aba2-3c52d68c3f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.268537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2dcbcdb3-0415-4951-aba2-3c52d68c3f43 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.269950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2dcbcdb3-0415-4951-aba2-3c52d68c3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.278014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 784/1566] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.279303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dbc64-77e8-4535-88f3-72a38c4728d7 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.279590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dbc64-77e8-4535-88f3-72a38c4728d7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.279901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dbc64-77e8-4535-88f3-72a38c4728d7 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.281244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 785/1567] 10.222.0.82 () {54 vars in 962 bytes} [Mon Aug 29 19:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:34.282305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5172154-b03f-410f-b418-7ee73a9ca21a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.282606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5172154-b03f-410f-b418-7ee73a9ca21a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.282903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5172154-b03f-410f-b418-7ee73a9ca21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.308657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c5172154-b03f-410f-b418-7ee73a9ca21a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.309860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c5172154-b03f-410f-b418-7ee73a9ca21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.319188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 786/1568] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.320019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5172154-b03f-410f-b418-7ee73a9ca21a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.329645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5172154-b03f-410f-b418-7ee73a9ca21a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.335514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.336064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.336347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.336620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.337296 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:34.337602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.339437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.352991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 787/1569] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:34.353831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.363189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b533f-1242-4ff4-83f8-7df202796070 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.368092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530afc1f-317a-4401-82ac-0cb46fd7d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.368668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afc1f-317a-4401-82ac-0cb46fd7d9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.368947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afc1f-317a-4401-82ac-0cb46fd7d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.369222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530afc1f-317a-4401-82ac-0cb46fd7d9b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.369877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530afc1f-317a-4401-82ac-0cb46fd7d9b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:34.370180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530afc1f-317a-4401-82ac-0cb46fd7d9b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.371916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530afc1f-317a-4401-82ac-0cb46fd7d9b3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.383613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 783/1570] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/users => generated 288 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:34.384589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124433b-27ef-4376-94f6-8ff982c14baf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.391660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 788/1571] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:34.392972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e3af4-890f-4afb-919d-e36e72f2e948 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.397227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e3af4-890f-4afb-919d-e36e72f2e948 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.397227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e3af4-890f-4afb-919d-e36e72f2e948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.397506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124433b-27ef-4376-94f6-8ff982c14baf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.401256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf15bd-8921-4d08-943b-06987da0fac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.401896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf15bd-8921-4d08-943b-06987da0fac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.402394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf15bd-8921-4d08-943b-06987da0fac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.402671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf15bd-8921-4d08-943b-06987da0fac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.404260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf15bd-8921-4d08-943b-06987da0fac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.405866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf15bd-8921-4d08-943b-06987da0fac9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.414648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-466e3af4-890f-4afb-919d-e36e72f2e948 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.415943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-466e3af4-890f-4afb-919d-e36e72f2e948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.417577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 784/1572] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:34.418458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf15bd-8921-4d08-943b-06987da0fac9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.424812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 789/1573] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.430630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed502-c770-4b13-a066-291c5e8f45e8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.430921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed502-c770-4b13-a066-291c5e8f45e8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.431263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ed502-c770-4b13-a066-291c5e8f45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.434307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf15bd-8921-4d08-943b-06987da0fac9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.438876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.444645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.444645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.444645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.444645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:34.444645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.444645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.456694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 785/1574] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:34.458028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.469087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d171b1-054a-4dbf-a667-ab3eeb28394e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.474818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.475430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.476023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.476300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.477250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:34.477250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.478820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.480200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a33ed502-c770-4b13-a066-291c5e8f45e8 None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:34.481408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a33ed502-c770-4b13-a066-291c5e8f45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:34.491288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 786/1575] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:34.492296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.493599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:34.501954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6daa-a785-4420-bb7d-14c62bee2295 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.509434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138378a-5a16-4f64-8778-ce40b8434a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.510057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138378a-5a16-4f64-8778-ce40b8434a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.510340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138378a-5a16-4f64-8778-ce40b8434a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.510622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138378a-5a16-4f64-8778-ce40b8434a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.511783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138378a-5a16-4f64-8778-ce40b8434a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.513753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138378a-5a16-4f64-8778-ce40b8434a87 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.555388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 790/1576] 10.222.0.82 () {58 vars in 1059 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:34.556273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ed502-c770-4b13-a066-291c5e8f45e8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.566925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ed502-c770-4b13-a066-291c5e8f45e8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.572612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8c8fa-0e2c-4e38-b14f-03ed29738209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.573212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8c8fa-0e2c-4e38-b14f-03ed29738209 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.573492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8c8fa-0e2c-4e38-b14f-03ed29738209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.573763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8c8fa-0e2c-4e38-b14f-03ed29738209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.574407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8c8fa-0e2c-4e38-b14f-03ed29738209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.576245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8c8fa-0e2c-4e38-b14f-03ed29738209 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.586497 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 791/1577] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:34.587288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8c8fa-0e2c-4e38-b14f-03ed29738209 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.597910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8c8fa-0e2c-4e38-b14f-03ed29738209 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.602602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0690c29-b2a6-464b-96cb-915149b42fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.603194 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0690c29-b2a6-464b-96cb-915149b42fed admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.603475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0690c29-b2a6-464b-96cb-915149b42fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.603776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0690c29-b2a6-464b-96cb-915149b42fed admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.604407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0690c29-b2a6-464b-96cb-915149b42fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.606346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0690c29-b2a6-464b-96cb-915149b42fed admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.621429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 787/1578] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:34.623944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138378a-5a16-4f64-8778-ce40b8434a87 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.672467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:34.686819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138378a-5a16-4f64-8778-ce40b8434a87 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.691617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad1a46-b069-4d13-b559-443081ae9b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.692953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1a46-b069-4d13-b559-443081ae9b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.693329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1a46-b069-4d13-b559-443081ae9b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.693601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1a46-b069-4d13-b559-443081ae9b4c admin admin] PATH_INFO: `/v3/projects/20ff3cf1cbf14f5690951226556e46fa/users/303d742b77ed4eb798b7f28117b89c75/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.708398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1a46-b069-4d13-b559-443081ae9b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ff3cf1cbf14f5690951226556e46fa, user_id=303d742b77ed4eb798b7f28117b89c75, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.711170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1a46-b069-4d13-b559-443081ae9b4c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.717978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 792/1579] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:34.718822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0690c29-b2a6-464b-96cb-915149b42fed admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.789053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0690c29-b2a6-464b-96cb-915149b42fed admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.793604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.794206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.794484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.794761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.795405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:34.795705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.797316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.809033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 788/1580] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:34 2022] PUT /identity/v3/projects/20ff3cf1cbf14f5690951226556e46fa/users/303d742b77ed4eb798b7f28117b89c75/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:34.810061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad1a46-b069-4d13-b559-443081ae9b4c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.813069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 793/1581] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:34.813069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:34.824290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4d665-bdaa-4d2b-a901-7f71c4890918 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.876532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad1a46-b069-4d13-b559-443081ae9b4c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:34.881132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1692-9ea1-4bdc-9640-b14582433f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.881740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1692-9ea1-4bdc-9640-b14582433f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.882020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1692-9ea1-4bdc-9640-b14582433f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.882294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d1692-9ea1-4bdc-9640-b14582433f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.882931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1692-9ea1-4bdc-9640-b14582433f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.884945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d1692-9ea1-4bdc-9640-b14582433f3f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.890093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d1b50-83c4-4dbe-9361-f3d0306ea5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:34.890709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d1b50-83c4-4dbe-9361-f3d0306ea5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:34.890994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d1b50-83c4-4dbe-9361-f3d0306ea5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:34.891272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d1b50-83c4-4dbe-9361-f3d0306ea5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:34.891939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d1b50-83c4-4dbe-9361-f3d0306ea5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:34.893869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d1b50-83c4-4dbe-9361-f3d0306ea5e8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:34.908721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:35.049857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 789/1582] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/projects => generated 405 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:35.050852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1692-9ea1-4bdc-9640-b14582433f3f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.066884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 794/1583] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:34 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:35.066884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d1b50-83c4-4dbe-9361-f3d0306ea5e8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.123283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d1692-9ea1-4bdc-9640-b14582433f3f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.129003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d1b50-83c4-4dbe-9361-f3d0306ea5e8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.133718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078e41-7a28-4d9d-8ca6-154ced2efae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.134324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078e41-7a28-4d9d-8ca6-154ced2efae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.134603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078e41-7a28-4d9d-8ca6-154ced2efae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.134876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078e41-7a28-4d9d-8ca6-154ced2efae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.135526 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90078e41-7a28-4d9d-8ca6-154ced2efae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.137160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90078e41-7a28-4d9d-8ca6-154ced2efae7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.152458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 795/1584] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:35.152458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078e41-7a28-4d9d-8ca6-154ced2efae7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.164352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078e41-7a28-4d9d-8ca6-154ced2efae7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.169062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430eaa4-d97d-48e8-9c55-b7fb7d8a5eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.169674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430eaa4-d97d-48e8-9c55-b7fb7d8a5eff admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.170123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430eaa4-d97d-48e8-9c55-b7fb7d8a5eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.170399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430eaa4-d97d-48e8-9c55-b7fb7d8a5eff admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.171031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430eaa4-d97d-48e8-9c55-b7fb7d8a5eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.173136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430eaa4-d97d-48e8-9c55-b7fb7d8a5eff admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.180485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:35.195288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e303b-09cb-4aeb-8748-4ffa2fef31fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.195939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e303b-09cb-4aeb-8748-4ffa2fef31fe service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.196220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e303b-09cb-4aeb-8748-4ffa2fef31fe service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.196514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e303b-09cb-4aeb-8748-4ffa2fef31fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.251922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e303b-09cb-4aeb-8748-4ffa2fef31fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.253493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e303b-09cb-4aeb-8748-4ffa2fef31fe service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.262240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 790/1585] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:35.263007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e303b-09cb-4aeb-8748-4ffa2fef31fe service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.273674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e303b-09cb-4aeb-8748-4ffa2fef31fe service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.280123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7e5a-eea3-4a3c-ab01-941efade9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.280123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7e5a-eea3-4a3c-ab01-941efade9848 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.280123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7e5a-eea3-4a3c-ab01-941efade9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.280123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7e5a-eea3-4a3c-ab01-941efade9848 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.280539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e7e5a-eea3-4a3c-ab01-941efade9848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.282151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e7e5a-eea3-4a3c-ab01-941efade9848 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.314258 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 796/1586] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:35.315862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3dd6b-8485-4e74-9a42-0ae515266adb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.316254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3dd6b-8485-4e74-9a42-0ae515266adb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.316635 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3dd6b-8485-4e74-9a42-0ae515266adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.338095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-99b3dd6b-8485-4e74-9a42-0ae515266adb None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:35.339411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-99b3dd6b-8485-4e74-9a42-0ae515266adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:35.347777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 797/1587] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:35.348886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3dd6b-8485-4e74-9a42-0ae515266adb None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.359979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3dd6b-8485-4e74-9a42-0ae515266adb None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.365698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e8269-8321-4879-9745-e20d6f4800a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.368965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e8269-8321-4879-9745-e20d6f4800a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.368965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e8269-8321-4879-9745-e20d6f4800a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.368965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e8269-8321-4879-9745-e20d6f4800a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.368965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e8269-8321-4879-9745-e20d6f4800a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.369554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e8269-8321-4879-9745-e20d6f4800a8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.394698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 791/1588] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:35.395953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7e5a-eea3-4a3c-ab01-941efade9848 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.406068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7e5a-eea3-4a3c-ab01-941efade9848 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.411077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7b24-6bfb-4355-ac00-298180740dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.411761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7b24-6bfb-4355-ac00-298180740dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.412048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7b24-6bfb-4355-ac00-298180740dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.412319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7b24-6bfb-4355-ac00-298180740dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.412946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c7b24-6bfb-4355-ac00-298180740dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.414906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c7b24-6bfb-4355-ac00-298180740dd1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.527562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 798/1589] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:35.528311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e8269-8321-4879-9745-e20d6f4800a8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.588950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e8269-8321-4879-9745-e20d6f4800a8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.593837 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97943bc7-f5f5-4542-a1af-8129ea5b4bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.594568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97943bc7-f5f5-4542-a1af-8129ea5b4bff admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.594845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97943bc7-f5f5-4542-a1af-8129ea5b4bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.595112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97943bc7-f5f5-4542-a1af-8129ea5b4bff admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.595788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97943bc7-f5f5-4542-a1af-8129ea5b4bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.598889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97943bc7-f5f5-4542-a1af-8129ea5b4bff admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.634833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 792/1590] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/users => generated 303 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:35.643527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7b24-6bfb-4355-ac00-298180740dd1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.655049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7b24-6bfb-4355-ac00-298180740dd1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.659663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919ab61-cb89-4a3b-830b-fc478fd25bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.660345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919ab61-cb89-4a3b-830b-fc478fd25bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.661369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919ab61-cb89-4a3b-830b-fc478fd25bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.661693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919ab61-cb89-4a3b-830b-fc478fd25bd5 admin admin] PATH_INFO: `/v3/projects/4241c5f57c3a4aeca455faec5f9c75f2/users/c7f5fe359aca4be3a2e609465298d637/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.677262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919ab61-cb89-4a3b-830b-fc478fd25bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4241c5f57c3a4aeca455faec5f9c75f2, user_id=c7f5fe359aca4be3a2e609465298d637, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.679905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919ab61-cb89-4a3b-830b-fc478fd25bd5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.705391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 799/1591] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:35.706249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97943bc7-f5f5-4542-a1af-8129ea5b4bff admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.715997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97943bc7-f5f5-4542-a1af-8129ea5b4bff admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.720597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9352a7-16b4-44e2-8c20-f702d001f6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.721183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9352a7-16b4-44e2-8c20-f702d001f6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.721463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9352a7-16b4-44e2-8c20-f702d001f6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.721734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9352a7-16b4-44e2-8c20-f702d001f6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.722367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9352a7-16b4-44e2-8c20-f702d001f6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.724674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9352a7-16b4-44e2-8c20-f702d001f6dd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.735652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 800/1592] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:35.736456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9352a7-16b4-44e2-8c20-f702d001f6dd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.761233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:35.786055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 793/1593] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:35 2022] PUT /identity/v3/projects/4241c5f57c3a4aeca455faec5f9c75f2/users/c7f5fe359aca4be3a2e609465298d637/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:35.794612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919ab61-cb89-4a3b-830b-fc478fd25bd5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.794753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9352a7-16b4-44e2-8c20-f702d001f6dd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.841427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e545-d821-450a-baff-607a31485917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.842042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e545-d821-450a-baff-607a31485917 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.842314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e545-d821-450a-baff-607a31485917 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.842586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e545-d821-450a-baff-607a31485917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.852416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919ab61-cb89-4a3b-830b-fc478fd25bd5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.852717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e545-d821-450a-baff-607a31485917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.854142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e545-d821-450a-baff-607a31485917 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.857095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9c1cc-7b74-449e-be37-4f2b3d6efcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.857756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c1cc-7b74-449e-be37-4f2b3d6efcce admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.858044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c1cc-7b74-449e-be37-4f2b3d6efcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.858323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9c1cc-7b74-449e-be37-4f2b3d6efcce admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.858972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9c1cc-7b74-449e-be37-4f2b3d6efcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.860613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9c1cc-7b74-449e-be37-4f2b3d6efcce admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.863661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 801/1594] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:35.865004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eea8a-50e6-4375-b9eb-d100bf740f47 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.865291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eea8a-50e6-4375-b9eb-d100bf740f47 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.865569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eea8a-50e6-4375-b9eb-d100bf740f47 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.866815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 802/1595] 10.222.0.82 () {54 vars in 912 bytes} [Mon Aug 29 19:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:35.867487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eea8a-50e6-4375-b9eb-d100bf740f47 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.875636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 794/1596] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:35.875636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9c1cc-7b74-449e-be37-4f2b3d6efcce admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.881347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eea8a-50e6-4375-b9eb-d100bf740f47 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.884192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9c1cc-7b74-449e-be37-4f2b3d6efcce admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.886520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db454-403e-4f1a-b591-6f958762e074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.887210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db454-403e-4f1a-b591-6f958762e074 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.887488 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db454-403e-4f1a-b591-6f958762e074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.887781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db454-403e-4f1a-b591-6f958762e074 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.888411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db454-403e-4f1a-b591-6f958762e074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.890020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f75f-10f7-4331-a440-18df60f89594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.890403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db454-403e-4f1a-b591-6f958762e074 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.890815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f75f-10f7-4331-a440-18df60f89594 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.891156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f75f-10f7-4331-a440-18df60f89594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.891580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f75f-10f7-4331-a440-18df60f89594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.892239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35f75f-10f7-4331-a440-18df60f89594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.893892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35f75f-10f7-4331-a440-18df60f89594 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.905510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 795/1597] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:35.906316 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f75f-10f7-4331-a440-18df60f89594 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.919076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f75f-10f7-4331-a440-18df60f89594 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.923995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249757d-9a04-4855-aef7-bf47c7eb550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.924599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249757d-9a04-4855-aef7-bf47c7eb550d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.924891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249757d-9a04-4855-aef7-bf47c7eb550d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.925167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249757d-9a04-4855-aef7-bf47c7eb550d admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.925804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249757d-9a04-4855-aef7-bf47c7eb550d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.927665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249757d-9a04-4855-aef7-bf47c7eb550d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.938593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 796/1598] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:35.939398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249757d-9a04-4855-aef7-bf47c7eb550d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:35.948972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249757d-9a04-4855-aef7-bf47c7eb550d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:35.953852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc966b-23bc-4b6e-8750-584120e46141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:35.954442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc966b-23bc-4b6e-8750-584120e46141 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.954730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc966b-23bc-4b6e-8750-584120e46141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.955007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc966b-23bc-4b6e-8750-584120e46141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.955646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc966b-23bc-4b6e-8750-584120e46141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:35.957290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc966b-23bc-4b6e-8750-584120e46141 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:35.959101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:35.968364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 797/1599] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:35.969391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317ea82-17bf-46f4-9815-39483760da1c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:35.969677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317ea82-17bf-46f4-9815-39483760da1c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:35.969956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317ea82-17bf-46f4-9815-39483760da1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:35.989621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3317ea82-17bf-46f4-9815-39483760da1c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:35.990873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3317ea82-17bf-46f4-9815-39483760da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:36.000690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 798/1600] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:36.003196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898bbbc-f5fc-4d1e-8185-7582c7f99fb2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.003196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898bbbc-f5fc-4d1e-8185-7582c7f99fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.003196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898bbbc-f5fc-4d1e-8185-7582c7f99fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.012965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 803/1601] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:36.013908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db454-403e-4f1a-b591-6f958762e074 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.024917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0898bbbc-f5fc-4d1e-8185-7582c7f99fb2 None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:36.029240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db454-403e-4f1a-b591-6f958762e074 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.029369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0898bbbc-f5fc-4d1e-8185-7582c7f99fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:36.030682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34cdac-125c-4788-8c66-b920f22e8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.031373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34cdac-125c-4788-8c66-b920f22e8648 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.032047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34cdac-125c-4788-8c66-b920f22e8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.032047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34cdac-125c-4788-8c66-b920f22e8648 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.032846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34cdac-125c-4788-8c66-b920f22e8648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.034219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34cdac-125c-4788-8c66-b920f22e8648 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.047341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 804/1602] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:36.048104 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34cdac-125c-4788-8c66-b920f22e8648 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.059398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34cdac-125c-4788-8c66-b920f22e8648 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.064864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e9c6-7318-48c5-a798-e4f34e93a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.066291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e9c6-7318-48c5-a798-e4f34e93a26b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.066291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e9c6-7318-48c5-a798-e4f34e93a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.066291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65e9c6-7318-48c5-a798-e4f34e93a26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.066995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65e9c6-7318-48c5-a798-e4f34e93a26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.068778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65e9c6-7318-48c5-a798-e4f34e93a26b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.081214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 805/1603] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:36.085676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e9c6-7318-48c5-a798-e4f34e93a26b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.095664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65e9c6-7318-48c5-a798-e4f34e93a26b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.101462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb0825-e9ef-4ae7-b68d-034b6e8f2706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.102060 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0825-e9ef-4ae7-b68d-034b6e8f2706 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.102339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0825-e9ef-4ae7-b68d-034b6e8f2706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.102610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb0825-e9ef-4ae7-b68d-034b6e8f2706 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.103248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb0825-e9ef-4ae7-b68d-034b6e8f2706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.104284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 799/1604] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:17:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:36.105064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb0825-e9ef-4ae7-b68d-034b6e8f2706 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.105279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898bbbc-f5fc-4d1e-8185-7582c7f99fb2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.116215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 806/1605] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:36.117103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb0825-e9ef-4ae7-b68d-034b6e8f2706 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.117265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898bbbc-f5fc-4d1e-8185-7582c7f99fb2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.123013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe7ef-c565-414e-88b2-4fa21bc360c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.123681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe7ef-c565-414e-88b2-4fa21bc360c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.124336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe7ef-c565-414e-88b2-4fa21bc360c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.124336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fe7ef-c565-414e-88b2-4fa21bc360c3 admin admin] PATH_INFO: `/v3/projects/92146a5d1add4653ad02d4052ae2bc2d/users/fc6b4d828f3f4a0fa8bcbd8266c7aa07/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.128870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb0825-e9ef-4ae7-b68d-034b6e8f2706 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.133680 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3cbe-86ea-443e-a564-be5a2b10dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.134428 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3cbe-86ea-443e-a564-be5a2b10dd68 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.134712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3cbe-86ea-443e-a564-be5a2b10dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.134992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d3cbe-86ea-443e-a564-be5a2b10dd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.135630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d3cbe-86ea-443e-a564-be5a2b10dd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.137373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d3cbe-86ea-443e-a564-be5a2b10dd68 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.144085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe7ef-c565-414e-88b2-4fa21bc360c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92146a5d1add4653ad02d4052ae2bc2d, user_id=fc6b4d828f3f4a0fa8bcbd8266c7aa07, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.144211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fe7ef-c565-414e-88b2-4fa21bc360c3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.148269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 807/1606] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:36.152192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3cbe-86ea-443e-a564-be5a2b10dd68 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.163684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d3cbe-86ea-443e-a564-be5a2b10dd68 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.167934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6de79-e2f3-43d0-8ea4-9a975f42443b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.168416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6de79-e2f3-43d0-8ea4-9a975f42443b service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.168690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6de79-e2f3-43d0-8ea4-9a975f42443b service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.168958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6de79-e2f3-43d0-8ea4-9a975f42443b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.179760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6de79-e2f3-43d0-8ea4-9a975f42443b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.181272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6de79-e2f3-43d0-8ea4-9a975f42443b service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.193462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 808/1607] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:36.194465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6de79-e2f3-43d0-8ea4-9a975f42443b service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.205333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6de79-e2f3-43d0-8ea4-9a975f42443b service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.210884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.211822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.215385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.215385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] PATH_INFO: `/v3/projects/32740723d2a14728ac1122156e5e3ae5/users/831190b97d2c4f36bfbaaf444ff20ab5/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.240239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32740723d2a14728ac1122156e5e3ae5, user_id=831190b97d2c4f36bfbaaf444ff20ab5, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.241894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:17:36.241894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 29 19:17:36.241894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: Aug 29 19:17:36.243842 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.259854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 800/1608] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:36 2022] PUT /identity/v3/projects/92146a5d1add4653ad02d4052ae2bc2d/users/fc6b4d828f3f4a0fa8bcbd8266c7aa07/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:36.259854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe7ef-c565-414e-88b2-4fa21bc360c3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.338006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fe7ef-c565-414e-88b2-4fa21bc360c3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.343094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffecf02-034f-40e5-8bb1-8e21d1f741f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.344242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffecf02-034f-40e5-8bb1-8e21d1f741f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.344242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffecf02-034f-40e5-8bb1-8e21d1f741f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.344503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffecf02-034f-40e5-8bb1-8e21d1f741f3 admin admin] PATH_INFO: `/v3/projects/908eff06e6d64608acefb8706e4d8314/users/73ac613e5259485cb3057ea0d2abc219/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.363444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffecf02-034f-40e5-8bb1-8e21d1f741f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908eff06e6d64608acefb8706e4d8314, user_id=73ac613e5259485cb3057ea0d2abc219, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.367132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffecf02-034f-40e5-8bb1-8e21d1f741f3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.406746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 809/1609] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:36 2022] PUT /identity/v3/projects/32740723d2a14728ac1122156e5e3ae5/users/831190b97d2c4f36bfbaaf444ff20ab5/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:36.408593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.481824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 801/1610] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:36 2022] PUT /identity/v3/projects/908eff06e6d64608acefb8706e4d8314/users/73ac613e5259485cb3057ea0d2abc219/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:36.481824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffecf02-034f-40e5-8bb1-8e21d1f741f3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.482575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:36.508273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eecea-dbdf-4d2f-b3fd-8031dc00e0b0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.572370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:36.579552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a30639-71c5-4473-a915-14422d657d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.580331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a30639-71c5-4473-a915-14422d657d25 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.580676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a30639-71c5-4473-a915-14422d657d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.581315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a30639-71c5-4473-a915-14422d657d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.649006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffecf02-034f-40e5-8bb1-8e21d1f741f3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.663063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831e915-e6de-477c-9e25-9e9c9a886ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.671422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831e915-e6de-477c-9e25-9e9c9a886ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.671422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831e915-e6de-477c-9e25-9e9c9a886ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.671422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831e915-e6de-477c-9e25-9e9c9a886ab2 admin admin] PATH_INFO: `/v3/projects/92f8c1d4dd3c41b99bd8df6b328fc1c0/users/f534257027f34264bedd3d148ed37fe8/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.692676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a30639-71c5-4473-a915-14422d657d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.694455 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a30639-71c5-4473-a915-14422d657d25 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.703255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831e915-e6de-477c-9e25-9e9c9a886ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f8c1d4dd3c41b99bd8df6b328fc1c0, user_id=f534257027f34264bedd3d148ed37fe8, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.704343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831e915-e6de-477c-9e25-9e9c9a886ab2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.708945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 810/1611] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:36.709947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a30639-71c5-4473-a915-14422d657d25 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.721908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a30639-71c5-4473-a915-14422d657d25 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.730007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847d60-9c6a-42b2-aa19-8c7af9ab308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.730007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847d60-9c6a-42b2-aa19-8c7af9ab308e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.730007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847d60-9c6a-42b2-aa19-8c7af9ab308e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.730007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847d60-9c6a-42b2-aa19-8c7af9ab308e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.730334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06847d60-9c6a-42b2-aa19-8c7af9ab308e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:36.732291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06847d60-9c6a-42b2-aa19-8c7af9ab308e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:36.749311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 811/1612] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:36.749311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d856e-43bf-49ab-b000-1c49abe69573 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.749311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d856e-43bf-49ab-b000-1c49abe69573 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.749311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d856e-43bf-49ab-b000-1c49abe69573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.797644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 802/1613] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:36 2022] PUT /identity/v3/projects/92f8c1d4dd3c41b99bd8df6b328fc1c0/users/f534257027f34264bedd3d148ed37fe8/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:36.800922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9521136-df90-4c19-82b7-eeb26a5041ff None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.803138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9521136-df90-4c19-82b7-eeb26a5041ff None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.807786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9521136-df90-4c19-82b7-eeb26a5041ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.816734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f53d856e-43bf-49ab-b000-1c49abe69573 None None] MFA Rules not processed for user `fc6b4d828f3f4a0fa8bcbd8266c7aa07`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:36.819091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f53d856e-43bf-49ab-b000-1c49abe69573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:36.837580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f9521136-df90-4c19-82b7-eeb26a5041ff None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:36.840076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f9521136-df90-4c19-82b7-eeb26a5041ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:36.948273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 812/1614] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:36.953864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 803/1615] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:36.954789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9521136-df90-4c19-82b7-eeb26a5041ff None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:36.966352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c554e-df55-4660-bb90-70f9ed371bc2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.966709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c554e-df55-4660-bb90-70f9ed371bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.966928 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c554e-df55-4660-bb90-70f9ed371bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:36.968978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9521136-df90-4c19-82b7-eeb26a5041ff None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:36.982099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59df3d-6737-4340-a08c-79bdea68dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:36.982702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59df3d-6737-4340-a08c-79bdea68dcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:36.982994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59df3d-6737-4340-a08c-79bdea68dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:36.983319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59df3d-6737-4340-a08c-79bdea68dcaf admin admin] PATH_INFO: `/v3/projects/a6181d9818b1466189aa3d451e55e322/users/d56991587da141848061c34471a4fb04/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.020503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59df3d-6737-4340-a08c-79bdea68dcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6181d9818b1466189aa3d451e55e322, user_id=d56991587da141848061c34471a4fb04, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:37.024637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59df3d-6737-4340-a08c-79bdea68dcaf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:37.036748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-730c554e-df55-4660-bb90-70f9ed371bc2 None None] MFA Rules not processed for user `73ac613e5259485cb3057ea0d2abc219`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:37.039074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-730c554e-df55-4660-bb90-70f9ed371bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:37.047935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:37.188133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 804/1616] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:36 2022] PUT /identity/v3/projects/a6181d9818b1466189aa3d451e55e322/users/d56991587da141848061c34471a4fb04/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:37.189687 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6d29-240b-4342-87d2-83838f4ecd69 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.190151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6d29-240b-4342-87d2-83838f4ecd69 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.190426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6d29-240b-4342-87d2-83838f4ecd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.203375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 813/1617] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:37.205058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c554e-df55-4660-bb90-70f9ed371bc2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:37.227084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c554e-df55-4660-bb90-70f9ed371bc2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:37.229819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9d2b6d29-240b-4342-87d2-83838f4ecd69 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:37.231111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9d2b6d29-240b-4342-87d2-83838f4ecd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:37.302414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105aeb8c-85ed-4b1b-8581-0109e458e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:37.303657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aeb8c-85ed-4b1b-8581-0109e458e1dd admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.304335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aeb8c-85ed-4b1b-8581-0109e458e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.304803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105aeb8c-85ed-4b1b-8581-0109e458e1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.305479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aeb8c-85ed-4b1b-8581-0109e458e1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:37.307422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105aeb8c-85ed-4b1b-8581-0109e458e1dd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:37.322938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 805/1618] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:37.325564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b6d29-240b-4342-87d2-83838f4ecd69 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:37.381827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:37.400028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b6d29-240b-4342-87d2-83838f4ecd69 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:37.407226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3cc8-3bc3-4463-ac68-c39d3429ecaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:37.407226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3cc8-3bc3-4463-ac68-c39d3429ecaa service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.407226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3cc8-3bc3-4463-ac68-c39d3429ecaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.407226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b3cc8-3bc3-4463-ac68-c39d3429ecaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.420535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b3cc8-3bc3-4463-ac68-c39d3429ecaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:37.421954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b3cc8-3bc3-4463-ac68-c39d3429ecaa service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:37.449020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 814/1619] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:37 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:37.449020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fc2f4-f23a-43c5-a000-e79297a6afdc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.449020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fc2f4-f23a-43c5-a000-e79297a6afdc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.449020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fc2f4-f23a-43c5-a000-e79297a6afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.461957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 806/1620] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:37.463616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3cc8-3bc3-4463-ac68-c39d3429ecaa service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:37.489589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0e5fc2f4-f23a-43c5-a000-e79297a6afdc None None] MFA Rules not processed for user `d56991587da141848061c34471a4fb04`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:37.491903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0e5fc2f4-f23a-43c5-a000-e79297a6afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:37.497406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b3cc8-3bc3-4463-ac68-c39d3429ecaa service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:37.581713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5ed22-677d-4819-accc-068421c44dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:37.582693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5ed22-677d-4819-accc-068421c44dfa admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.583317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5ed22-677d-4819-accc-068421c44dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.583842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5ed22-677d-4819-accc-068421c44dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.584941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5ed22-677d-4819-accc-068421c44dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:37.589196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5ed22-677d-4819-accc-068421c44dfa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:37.648581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 815/1621] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:37.649634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fc2f4-f23a-43c5-a000-e79297a6afdc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:37.716569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:37.762598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fc2f4-f23a-43c5-a000-e79297a6afdc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:37.775012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a7a4-32e4-41c4-ad7c-29ca2d91f43b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:37.776447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a7a4-32e4-41c4-ad7c-29ca2d91f43b service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.776447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a7a4-32e4-41c4-ad7c-29ca2d91f43b service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.777795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810a7a4-32e4-41c4-ad7c-29ca2d91f43b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.797403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810a7a4-32e4-41c4-ad7c-29ca2d91f43b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:37.818911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810a7a4-32e4-41c4-ad7c-29ca2d91f43b service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:37.833156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 816/1622] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:37.834355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a7a4-32e4-41c4-ad7c-29ca2d91f43b service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:37.838475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 807/1623] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:37 2022] POST /identity/v3/projects => generated 405 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:37.840094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778ba0-4683-47c1-8e84-e6265129361e None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.840523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778ba0-4683-47c1-8e84-e6265129361e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.840922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d778ba0-4683-47c1-8e84-e6265129361e None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.849038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 808/1624] 10.222.0.82 () {54 vars in 962 bytes} [Mon Aug 29 19:17:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:37.850092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778ba0-4683-47c1-8e84-e6265129361e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:37.851396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810a7a4-32e4-41c4-ad7c-29ca2d91f43b service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:37.940913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8eb3a-52e3-4651-95a4-512f0a5b2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:37.942355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8eb3a-52e3-4651-95a4-512f0a5b2be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.942656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8eb3a-52e3-4651-95a4-512f0a5b2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.942934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8eb3a-52e3-4651-95a4-512f0a5b2be0 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.944291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8eb3a-52e3-4651-95a4-512f0a5b2be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:37.949496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8eb3a-52e3-4651-95a4-512f0a5b2be0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:37.955257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d778ba0-4683-47c1-8e84-e6265129361e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:37.978310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec26ed-1e36-48bc-b5e2-d6a82682a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:37.979530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec26ed-1e36-48bc-b5e2-d6a82682a231 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:37.979861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec26ed-1e36-48bc-b5e2-d6a82682a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:37.980140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec26ed-1e36-48bc-b5e2-d6a82682a231 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:37.982220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec26ed-1e36-48bc-b5e2-d6a82682a231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:37.985584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec26ed-1e36-48bc-b5e2-d6a82682a231 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:38.171037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 817/1625] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:37 2022] POST /identity/v3/users => generated 300 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:38.173009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b74176-264a-42d2-9a72-7257afaf9099 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:38.173309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b74176-264a-42d2-9a72-7257afaf9099 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:38.173594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b74176-264a-42d2-9a72-7257afaf9099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:38.193808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 809/1626] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:37 2022] POST /identity/v3/users => generated 309 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:38.194695 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec26ed-1e36-48bc-b5e2-d6a82682a231 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:38.211076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec26ed-1e36-48bc-b5e2-d6a82682a231 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:38.226214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a2552-aa21-4d06-b507-16e70d81b085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:38.226854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a2552-aa21-4d06-b507-16e70d81b085 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:38.227138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a2552-aa21-4d06-b507-16e70d81b085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:38.227415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a2552-aa21-4d06-b507-16e70d81b085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:38.228185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a2552-aa21-4d06-b507-16e70d81b085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:38.230946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a2552-aa21-4d06-b507-16e70d81b085 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:38.240985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-06b74176-264a-42d2-9a72-7257afaf9099 None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:38.242414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-06b74176-264a-42d2-9a72-7257afaf9099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:38.251865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 810/1627] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:38.254749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a2552-aa21-4d06-b507-16e70d81b085 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:38.293293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a2552-aa21-4d06-b507-16e70d81b085 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:38.305707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5f312-a996-4a04-9646-365cd2e1c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:38.305951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f312-a996-4a04-9646-365cd2e1c456 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:38.306205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f312-a996-4a04-9646-365cd2e1c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:38.306906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f312-a996-4a04-9646-365cd2e1c456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:38.307122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5f312-a996-4a04-9646-365cd2e1c456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:38.308733 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5f312-a996-4a04-9646-365cd2e1c456 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:38.343458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 811/1628] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:38.344468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5f312-a996-4a04-9646-365cd2e1c456 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:38.369832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5f312-a996-4a04-9646-365cd2e1c456 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:38.383485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84485bd8-9369-4d9e-a402-4c004cddbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:38.384549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84485bd8-9369-4d9e-a402-4c004cddbdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:38.386207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84485bd8-9369-4d9e-a402-4c004cddbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:38.386680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84485bd8-9369-4d9e-a402-4c004cddbdc6 admin admin] PATH_INFO: `/v3/projects/fce4b6ac13c54dc49bb69dfb5b452647/users/d83ce2bb73f147f09d03d566880c6bf0/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:38.421952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 818/1629] 10.222.0.82 () {58 vars in 1059 bytes} [Mon Aug 29 19:17:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:38.423171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b74176-264a-42d2-9a72-7257afaf9099 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:38.429207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84485bd8-9369-4d9e-a402-4c004cddbdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce4b6ac13c54dc49bb69dfb5b452647, user_id=d83ce2bb73f147f09d03d566880c6bf0, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:38.435045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84485bd8-9369-4d9e-a402-4c004cddbdc6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:38.455388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b74176-264a-42d2-9a72-7257afaf9099 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:38.471131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c8cb-5b9f-4eb4-8d1a-786a785f8c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:38.472341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c8cb-5b9f-4eb4-8d1a-786a785f8c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:38.473981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c8cb-5b9f-4eb4-8d1a-786a785f8c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:38.474587 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447c8cb-5b9f-4eb4-8d1a-786a785f8c6b admin admin] PATH_INFO: `/v3/projects/aded35837d694421827ecb7a808625f2/users/c5004c2c0fac49249287182f841ad14a/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:38.516400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c8cb-5b9f-4eb4-8d1a-786a785f8c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aded35837d694421827ecb7a808625f2, user_id=c5004c2c0fac49249287182f841ad14a, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:38.523033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447c8cb-5b9f-4eb4-8d1a-786a785f8c6b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:38.584014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 812/1630] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:38 2022] PUT /identity/v3/projects/fce4b6ac13c54dc49bb69dfb5b452647/users/d83ce2bb73f147f09d03d566880c6bf0/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:38.584014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84485bd8-9369-4d9e-a402-4c004cddbdc6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:38.634210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:38.643062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 819/1631] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:38 2022] PUT /identity/v3/projects/aded35837d694421827ecb7a808625f2/users/c5004c2c0fac49249287182f841ad14a/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:38.643062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c8cb-5b9f-4eb4-8d1a-786a785f8c6b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:38.688070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:38.737197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447c8cb-5b9f-4eb4-8d1a-786a785f8c6b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:38.742909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d6ba8-7d9f-4145-9f76-56c9c61a97f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:38.744959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6ba8-7d9f-4145-9f76-56c9c61a97f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:38.745349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6ba8-7d9f-4145-9f76-56c9c61a97f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:38.745727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d6ba8-7d9f-4145-9f76-56c9c61a97f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:38.746539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d6ba8-7d9f-4145-9f76-56c9c61a97f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:38.748356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d6ba8-7d9f-4145-9f76-56c9c61a97f9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:38.762504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 820/1632] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:38.763539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d6ba8-7d9f-4145-9f76-56c9c61a97f9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:38.769626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84485bd8-9369-4d9e-a402-4c004cddbdc6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:38.778923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d6ba8-7d9f-4145-9f76-56c9c61a97f9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:38.786191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce494d1-9a79-4ca9-91ae-bc9af6b87ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:38.787495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce494d1-9a79-4ca9-91ae-bc9af6b87ead admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:38.787916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce494d1-9a79-4ca9-91ae-bc9af6b87ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:38.788293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce494d1-9a79-4ca9-91ae-bc9af6b87ead admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:38.789331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce494d1-9a79-4ca9-91ae-bc9af6b87ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:38.791680 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce494d1-9a79-4ca9-91ae-bc9af6b87ead admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:38.810842 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 821/1633] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:38.810842 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce494d1-9a79-4ca9-91ae-bc9af6b87ead admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:38.829102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce494d1-9a79-4ca9-91ae-bc9af6b87ead admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:38.838383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8e05-6244-45e4-8928-c5aff8368074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:38.839158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8e05-6244-45e4-8928-c5aff8368074 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:38.839629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8e05-6244-45e4-8928-c5aff8368074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:38.839927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8e05-6244-45e4-8928-c5aff8368074 admin admin] PATH_INFO: `/v3/projects/fce4b6ac13c54dc49bb69dfb5b452647/users/d83ce2bb73f147f09d03d566880c6bf0/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:38.842790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e8e05-6244-45e4-8928-c5aff8368074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce4b6ac13c54dc49bb69dfb5b452647, user_id=d83ce2bb73f147f09d03d566880c6bf0, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:38.846117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e8e05-6244-45e4-8928-c5aff8368074 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:39.243579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 822/1634] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:38 2022] PUT /identity/v3/projects/fce4b6ac13c54dc49bb69dfb5b452647/users/d83ce2bb73f147f09d03d566880c6bf0/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:39.243579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8e05-6244-45e4-8928-c5aff8368074 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:39.259468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fe505-8fc3-4015-a06f-45cd75ff8e62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:39.259468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe505-8fc3-4015-a06f-45cd75ff8e62 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:39.259468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe505-8fc3-4015-a06f-45cd75ff8e62 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:39.259468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fe505-8fc3-4015-a06f-45cd75ff8e62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:39.268219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8e05-6244-45e4-8928-c5aff8368074 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:39.268219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64846888-3a86-4607-9f0c-ff9f9792f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:39.268219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64846888-3a86-4607-9f0c-ff9f9792f9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:39.268219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64846888-3a86-4607-9f0c-ff9f9792f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:39.269642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64846888-3a86-4607-9f0c-ff9f9792f9ba admin admin] PATH_INFO: `/v3/projects/aded35837d694421827ecb7a808625f2/users/c5004c2c0fac49249287182f841ad14a/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:39.269642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64846888-3a86-4607-9f0c-ff9f9792f9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=aded35837d694421827ecb7a808625f2, user_id=c5004c2c0fac49249287182f841ad14a, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:39.269642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64846888-3a86-4607-9f0c-ff9f9792f9ba admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:39.270815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fe505-8fc3-4015-a06f-45cd75ff8e62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:39.270815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fe505-8fc3-4015-a06f-45cd75ff8e62 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:39.271265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 823/1635] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:38 2022] PUT /identity/v3/projects/aded35837d694421827ecb7a808625f2/users/c5004c2c0fac49249287182f841ad14a/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:39.271265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c30259-0bf1-4cc0-b5f9-8123f784f61c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:39.271265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c30259-0bf1-4cc0-b5f9-8123f784f61c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:39.271265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c30259-0bf1-4cc0-b5f9-8123f784f61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:39.272072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 813/1636] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:39.272072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f877fb9-8121-44fb-b835-d6a9616c8ceb None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:39.272072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f877fb9-8121-44fb-b835-d6a9616c8ceb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:39.272072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f877fb9-8121-44fb-b835-d6a9616c8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:39.272072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1f877fb9-8121-44fb-b835-d6a9616c8ceb None None] MFA Rules not processed for user `c5004c2c0fac49249287182f841ad14a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:39.272072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1f877fb9-8121-44fb-b835-d6a9616c8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:39.272610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e0c30259-0bf1-4cc0-b5f9-8123f784f61c None None] MFA Rules not processed for user `d83ce2bb73f147f09d03d566880c6bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:39.272610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0c30259-0bf1-4cc0-b5f9-8123f784f61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:39.278709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 814/1637] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:39 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:39.306095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f877fb9-8121-44fb-b835-d6a9616c8ceb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:39.445838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 824/1638] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:39.460871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c30259-0bf1-4cc0-b5f9-8123f784f61c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:39.618027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f877fb9-8121-44fb-b835-d6a9616c8ceb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:39.627541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c30259-0bf1-4cc0-b5f9-8123f784f61c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:39.632432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04de093-cc16-4a3d-b5b7-260e92d9d779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:39.633174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de093-cc16-4a3d-b5b7-260e92d9d779 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:39.633314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce3eb-a433-4164-a039-e9aa2ac3e06b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:39.633665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de093-cc16-4a3d-b5b7-260e92d9d779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:39.633951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce3eb-a433-4164-a039-e9aa2ac3e06b service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:39.634121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04de093-cc16-4a3d-b5b7-260e92d9d779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:39.635036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce3eb-a433-4164-a039-e9aa2ac3e06b service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:39.635330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce3eb-a433-4164-a039-e9aa2ac3e06b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:39.650546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce3eb-a433-4164-a039-e9aa2ac3e06b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:39.652725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce3eb-a433-4164-a039-e9aa2ac3e06b service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:39.653295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04de093-cc16-4a3d-b5b7-260e92d9d779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:39.654815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04de093-cc16-4a3d-b5b7-260e92d9d779 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:39.667399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 815/1639] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:39 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:39.668975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12b19-4783-45d7-842a-c8063ec616cc None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:39.669329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12b19-4783-45d7-842a-c8063ec616cc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:39.669675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12b19-4783-45d7-842a-c8063ec616cc None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:39.671568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 816/1640] 10.222.0.82 () {54 vars in 912 bytes} [Mon Aug 29 19:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:39.673141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 825/1641] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:39.687139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cca62-9b71-45a5-91c0-df63f8988f63 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:39.689765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cca62-9b71-45a5-91c0-df63f8988f63 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:39.689765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cca62-9b71-45a5-91c0-df63f8988f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:39.774603 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-785cca62-9b71-45a5-91c0-df63f8988f63 None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:39.782272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-785cca62-9b71-45a5-91c0-df63f8988f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:39.969953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce3eb-a433-4164-a039-e9aa2ac3e06b service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:40.015032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 817/1642] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:17:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:40.029870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cca62-9b71-45a5-91c0-df63f8988f63 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:40.041298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cca62-9b71-45a5-91c0-df63f8988f63 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:40.053703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:40.064749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490cf20-8b0f-46fc-9f8d-80dab27c3e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:40.064749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490cf20-8b0f-46fc-9f8d-80dab27c3e0c service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:40.064749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490cf20-8b0f-46fc-9f8d-80dab27c3e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:40.064749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490cf20-8b0f-46fc-9f8d-80dab27c3e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:40.099261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:40.104319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490cf20-8b0f-46fc-9f8d-80dab27c3e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:40.117473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490cf20-8b0f-46fc-9f8d-80dab27c3e0c service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:40.118275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce3eb-a433-4164-a039-e9aa2ac3e06b service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:40.127775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:40.128020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:40.128490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:40.128777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] PATH_INFO: `/v3/users/fc6b4d828f3f4a0fa8bcbd8266c7aa07` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:40.130648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6b4d828f3f4a0fa8bcbd8266c7aa07)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:40.131895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: WARNING py.warnings [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:17:40.131895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: warnings.warn(msg) Aug 29 19:17:40.131895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: Aug 29 19:17:40.133129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:40.169050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 818/1643] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:17:40.169834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490cf20-8b0f-46fc-9f8d-80dab27c3e0c service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:40.199023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490cf20-8b0f-46fc-9f8d-80dab27c3e0c service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:40.207301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:40.209253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:40.210026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:40.210452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] PATH_INFO: `/v3/users/73ac613e5259485cb3057ea0d2abc219` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:40.212025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ac613e5259485cb3057ea0d2abc219)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:40.214432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:40.470095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6b4d828f3f4a0fa8bcbd8266c7aa07'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.563304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ac613e5259485cb3057ea0d2abc219'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.563304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ac613e5259485cb3057ea0d2abc219'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.620527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6b4d828f3f4a0fa8bcbd8266c7aa07'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.621278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6b4d828f3f4a0fa8bcbd8266c7aa07'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.658474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6b4d828f3f4a0fa8bcbd8266c7aa07'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.659984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba919dac-3605-4db9-bac3-28efaa3c1b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6b4d828f3f4a0fa8bcbd8266c7aa07'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.716509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 826/1644] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:17:39 2022] DELETE /identity/v3/users/fc6b4d828f3f4a0fa8bcbd8266c7aa07 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:40.721966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0d8eb-8673-4b68-863f-9623dae1ff07 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:40.722267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0d8eb-8673-4b68-863f-9623dae1ff07 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:40.724572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0d8eb-8673-4b68-863f-9623dae1ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:40.765188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-52d0d8eb-8673-4b68-863f-9623dae1ff07 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:40.767868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-52d0d8eb-8673-4b68-863f-9623dae1ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:40.785534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ac613e5259485cb3057ea0d2abc219'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.787367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ac613e5259485cb3057ea0d2abc219'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.821320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-87f4aa9f-6cb9-40b6-b937-85dae49a8a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ac613e5259485cb3057ea0d2abc219'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:40.868075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 819/1645] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:17:40 2022] DELETE /identity/v3/users/73ac613e5259485cb3057ea0d2abc219 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:40.869839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98465ac-cb2e-49da-8a19-aa2ad861930f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:40.870137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98465ac-cb2e-49da-8a19-aa2ad861930f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:40.870415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98465ac-cb2e-49da-8a19-aa2ad861930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:40.950536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b98465ac-cb2e-49da-8a19-aa2ad861930f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:40.952084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b98465ac-cb2e-49da-8a19-aa2ad861930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:41.006851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:41.012785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 827/1646] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:41.091469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0d8eb-8673-4b68-863f-9623dae1ff07 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:41.093417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-52d0d8eb-8673-4b68-863f-9623dae1ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:41.147984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 820/1647] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:41.177221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98465ac-cb2e-49da-8a19-aa2ad861930f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:41.179041 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b98465ac-cb2e-49da-8a19-aa2ad861930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:41.230147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0d8eb-8673-4b68-863f-9623dae1ff07 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:41.346292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98465ac-cb2e-49da-8a19-aa2ad861930f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:41.359314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:41.360486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:41.360894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:41.361451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:41.387914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:41.390093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:41.412368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:41.412571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 821/1648] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:41.413154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:41.413348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:41.413580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:41.439880 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:41.444052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:41.471869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 828/1649] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:17:42.061679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:43.453729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:43.456021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:43.472158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82c86-b67c-4f2a-a19d-f916fa8b2a86 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:43.487218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:43.487218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:43.487218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:43.487218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] PATH_INFO: `/v3/projects/92146a5d1add4653ad02d4052ae2bc2d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:43.487581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=92146a5d1add4653ad02d4052ae2bc2d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:43.487581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: WARNING py.warnings [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 19:17:43.487581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: warnings.warn(msg) Aug 29 19:17:43.487581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: Aug 29 19:17:43.489153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:43.566816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:43.569677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:43.657155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af7d65-7bf9-4d9e-9149-0f1879bdbded service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:43.718736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92146a5d1add4653ad02d4052ae2bc2d', 'request_id': 'req-0a450921-7013-46fd-b510-7ea914f699dd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:43.839657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:43.841086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:43.841491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:43.841950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] PATH_INFO: `/v3/projects/908eff06e6d64608acefb8706e4d8314` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:43.843698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=908eff06e6d64608acefb8706e4d8314)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:43.846505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:43.876898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92146a5d1add4653ad02d4052ae2bc2d', 'request_id': 'req-0a450921-7013-46fd-b510-7ea914f699dd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:43.908251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92146a5d1add4653ad02d4052ae2bc2d', 'request_id': 'req-0a450921-7013-46fd-b510-7ea914f699dd'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:43.916306 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:43.947631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] The token cache is being invalidate because project 92146a5d1add4653ad02d4052ae2bc2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:17:43.948004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:43.950325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:43.953950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 822/1650] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:17:43 2022] DELETE /identity/v3/projects/92146a5d1add4653ad02d4052ae2bc2d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:17:43.958662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:43.963180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:43.994741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a450921-7013-46fd-b510-7ea914f699dd admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:44.016142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:44.016748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:44.017099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:44.017713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] PATH_INFO: `/v3/users/d83ce2bb73f147f09d03d566880c6bf0` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:44.019227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83ce2bb73f147f09d03d566880c6bf0)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:44.022521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:44.109892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908eff06e6d64608acefb8706e4d8314', 'request_id': 'req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.258823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908eff06e6d64608acefb8706e4d8314', 'request_id': 'req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.287311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908eff06e6d64608acefb8706e4d8314', 'request_id': 'req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.328846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] The token cache is being invalidate because project 908eff06e6d64608acefb8706e4d8314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:17:44.328846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.328846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.333507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 829/1651] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:17:43 2022] DELETE /identity/v3/projects/908eff06e6d64608acefb8706e4d8314 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:44.337305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:44.350511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:44.361863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83ce2bb73f147f09d03d566880c6bf0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.364805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83ce2bb73f147f09d03d566880c6bf0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.509927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8fe90-294f-4250-8c93-a67a2dc42a2e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:44.515781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:44.522614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:44.522614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:44.522614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] PATH_INFO: `/v3/users/c5004c2c0fac49249287182f841ad14a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:44.522614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5004c2c0fac49249287182f841ad14a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:44.522614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:44.556488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83ce2bb73f147f09d03d566880c6bf0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.564799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83ce2bb73f147f09d03d566880c6bf0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.596433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83ce2bb73f147f09d03d566880c6bf0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.639521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 823/1652] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:17:43 2022] DELETE /identity/v3/users/d83ce2bb73f147f09d03d566880c6bf0 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:44.643792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:44.654753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:44.671409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:44.903456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da18a9-ecde-447f-82a4-d624b79d7361 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:44.905296 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5004c2c0fac49249287182f841ad14a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:44.924053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:44.927363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:44.927363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:44.927363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] PATH_INFO: `/v3/users/d56991587da141848061c34471a4fb04` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:44.956655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56991587da141848061c34471a4fb04)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:44.960951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:45.078572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5004c2c0fac49249287182f841ad14a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.080421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5004c2c0fac49249287182f841ad14a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.115975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5004c2c0fac49249287182f841ad14a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.116989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f3c7d3f2-b1b7-4fd2-ab77-015397e9fed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5004c2c0fac49249287182f841ad14a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.149280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 830/1653] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:17:44 2022] DELETE /identity/v3/users/c5004c2c0fac49249287182f841ad14a => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:17:45.303182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56991587da141848061c34471a4fb04'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.304147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56991587da141848061c34471a4fb04'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.414600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56991587da141848061c34471a4fb04'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.415343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56991587da141848061c34471a4fb04'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.443913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56991587da141848061c34471a4fb04'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:45.481188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 824/1654] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:17:44 2022] DELETE /identity/v3/users/d56991587da141848061c34471a4fb04 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:45.486914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157ca0-3f29-467e-b72a-b0602e41294e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:45.487317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157ca0-3f29-467e-b72a-b0602e41294e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:45.487777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157ca0-3f29-467e-b72a-b0602e41294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:45.525667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-73157ca0-3f29-467e-b72a-b0602e41294e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:45.527329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-73157ca0-3f29-467e-b72a-b0602e41294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:45.624184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 831/1655] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:45.643228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:45.645986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:45.776343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d40c-1913-41af-abee-a20633b8b889 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:45.785356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:45.791553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:45.791553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:45.791553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:45.812958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:45.815776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:45.848937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 825/1656] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:46.546950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157ca0-3f29-467e-b72a-b0602e41294e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:46.549319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-73157ca0-3f29-467e-b72a-b0602e41294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:46.574549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157ca0-3f29-467e-b72a-b0602e41294e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:46.575036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:46.576927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:46.593572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:46.594241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:46.594453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f90c8-b9d8-46ba-8183-f7ff739c9dee service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:46.594571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:46.599873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] PATH_INFO: `/v3/users/43b97865b5a4406a9639a3ace6daac8d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:46.602231 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b97865b5a4406a9639a3ace6daac8d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:46.605252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:46.608448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:46.609111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:46.609391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:46.612554 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] PATH_INFO: `/v3/projects/fce4b6ac13c54dc49bb69dfb5b452647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:46.615186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce4b6ac13c54dc49bb69dfb5b452647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:46.618365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:46.942189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b97865b5a4406a9639a3ace6daac8d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:46.962690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce4b6ac13c54dc49bb69dfb5b452647', 'request_id': 'req-2075f518-cb40-4b72-bc58-8b2b8283d4dc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.036828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b97865b5a4406a9639a3ace6daac8d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.037683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b97865b5a4406a9639a3ace6daac8d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.070033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b97865b5a4406a9639a3ace6daac8d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.075892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8563e13b-3dbb-4d28-9ea0-ca228136424e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b97865b5a4406a9639a3ace6daac8d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.111499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 832/1657] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:17:46 2022] DELETE /identity/v3/users/43b97865b5a4406a9639a3ace6daac8d => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:47.117589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f1ec-372b-4d2a-b1df-f4e1290c6c2c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:47.118163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f1ec-372b-4d2a-b1df-f4e1290c6c2c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:47.118585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f1ec-372b-4d2a-b1df-f4e1290c6c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:47.122581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce4b6ac13c54dc49bb69dfb5b452647', 'request_id': 'req-2075f518-cb40-4b72-bc58-8b2b8283d4dc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.131590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce4b6ac13c54dc49bb69dfb5b452647', 'request_id': 'req-2075f518-cb40-4b72-bc58-8b2b8283d4dc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.167077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9b51f1ec-372b-4d2a-b1df-f4e1290c6c2c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:47.168768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9b51f1ec-372b-4d2a-b1df-f4e1290c6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:47.171681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] The token cache is being invalidate because project fce4b6ac13c54dc49bb69dfb5b452647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:17:47.172064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.173802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2075f518-cb40-4b72-bc58-8b2b8283d4dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.183522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 826/1658] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:17:46 2022] DELETE /identity/v3/projects/fce4b6ac13c54dc49bb69dfb5b452647 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:47.188732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3652-9a0d-4d95-9d56-518b9d9feee3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:47.189352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3652-9a0d-4d95-9d56-518b9d9feee3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:47.189843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf3652-9a0d-4d95-9d56-518b9d9feee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:47.245709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-46cf3652-9a0d-4d95-9d56-518b9d9feee3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:47.248861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-46cf3652-9a0d-4d95-9d56-518b9d9feee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:47.338523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 833/1659] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:47.352973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f1ec-372b-4d2a-b1df-f4e1290c6c2c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:47.354847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9b51f1ec-372b-4d2a-b1df-f4e1290c6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:47.357381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:47.374710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 827/1660] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:47.392332 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53445d-3929-4275-a532-376be1126670 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:47.392985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53445d-3929-4275-a532-376be1126670 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:47.393442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53445d-3929-4275-a532-376be1126670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:47.394907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f1ec-372b-4d2a-b1df-f4e1290c6c2c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:47.415745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:47.419244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:47.426468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:47.438157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] PATH_INFO: `/v3/projects/aded35837d694421827ecb7a808625f2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:47.438935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aded35837d694421827ecb7a808625f2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:47.446673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5f53445d-3929-4275-a532-376be1126670 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:47.448302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:47.448840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5f53445d-3929-4275-a532-376be1126670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:47.470268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 828/1661] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:47.472647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53445d-3929-4275-a532-376be1126670 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:47.480723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5f53445d-3929-4275-a532-376be1126670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:47.532348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:47.653700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53445d-3929-4275-a532-376be1126670 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:47.665375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aded35837d694421827ecb7a808625f2', 'request_id': 'req-fbc5fec5-8769-441f-97ec-c56b8790f3c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.776458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bd787-33ce-4c3b-bf17-90e175dec754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:47.777315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd787-33ce-4c3b-bf17-90e175dec754 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:47.777919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd787-33ce-4c3b-bf17-90e175dec754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:47.779043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aded35837d694421827ecb7a808625f2', 'request_id': 'req-fbc5fec5-8769-441f-97ec-c56b8790f3c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.782548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bd787-33ce-4c3b-bf17-90e175dec754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:47.799830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aded35837d694421827ecb7a808625f2', 'request_id': 'req-fbc5fec5-8769-441f-97ec-c56b8790f3c9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.826569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] The token cache is being invalidate because project aded35837d694421827ecb7a808625f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:17:47.826838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.836316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:47.841697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 834/1662] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:17:47 2022] DELETE /identity/v3/projects/aded35837d694421827ecb7a808625f2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:17:47.846098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:47.852888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:47.912629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bd787-33ce-4c3b-bf17-90e175dec754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:47.914358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bd787-33ce-4c3b-bf17-90e175dec754 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:47.924604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 829/1663] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:47.926698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004fcad-f258-4927-b32e-b63990c91431 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:47.927008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004fcad-f258-4927-b32e-b63990c91431 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:47.927287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004fcad-f258-4927-b32e-b63990c91431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:47.955504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1004fcad-f258-4927-b32e-b63990c91431 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:47.956840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1004fcad-f258-4927-b32e-b63990c91431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:47.970948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 830/1664] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:47.981137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24bef-c2bb-436c-b82a-a930e91d00ad None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:47.981422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24bef-c2bb-436c-b82a-a930e91d00ad None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:47.984422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c24bef-c2bb-436c-b82a-a930e91d00ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.024377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b1c24bef-c2bb-436c-b82a-a930e91d00ad None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:48.025219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b1c24bef-c2bb-436c-b82a-a930e91d00ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:48.041849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 831/1665] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:48.041849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24bef-c2bb-436c-b82a-a930e91d00ad None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:48.050670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5fec5-8769-441f-97ec-c56b8790f3c9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:48.076072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:48.076072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:48.076072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:48.076072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.076382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:48.076382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:48.076382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:48.078525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c24bef-c2bb-436c-b82a-a930e91d00ad None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:48.090369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:48.091170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:48.091564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:48.093910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.095313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:48.096399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:48.103895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:48.106448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 835/1666] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:48.107832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:48.110772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:48.144939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 832/1667] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:48.147707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:48.156145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138ad5d-7213-4061-a3f8-5d673612c68f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:48.168566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:48.176783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:48.176783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:48.176783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] PATH_INFO: `/v3/projects/a6181d9818b1466189aa3d451e55e322` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.178572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6181d9818b1466189aa3d451e55e322)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:48.182047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:48.185973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3617cb3b-8c4e-46e0-8fae-3af604f0ba02 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:48.195580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56487-a1b8-428a-a562-657cbd2451c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:48.196762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56487-a1b8-428a-a562-657cbd2451c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:48.197279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56487-a1b8-428a-a562-657cbd2451c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:48.197771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec56487-a1b8-428a-a562-657cbd2451c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.199101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56487-a1b8-428a-a562-657cbd2451c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:48.201988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec56487-a1b8-428a-a562-657cbd2451c2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:48.352823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 833/1668] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:48 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:48.354789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56487-a1b8-428a-a562-657cbd2451c2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:48.397092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6181d9818b1466189aa3d451e55e322', 'request_id': 'req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:48.505066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6181d9818b1466189aa3d451e55e322', 'request_id': 'req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:48.516204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6181d9818b1466189aa3d451e55e322', 'request_id': 'req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:48.530152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] The token cache is being invalidate because project a6181d9818b1466189aa3d451e55e322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:17:48.531048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:48.532706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:48.537349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 836/1669] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:17:48 2022] DELETE /identity/v3/projects/a6181d9818b1466189aa3d451e55e322 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:48.538591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:48.540931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:48.568745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec56487-a1b8-428a-a562-657cbd2451c2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:48.651270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcdfe4-df6e-4306-b4d4-8c2816338e60 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:48.658420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff23e1c-71ce-40a6-9632-a3af5ec8c3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:48.659371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23e1c-71ce-40a6-9632-a3af5ec8c3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:48.660132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23e1c-71ce-40a6-9632-a3af5ec8c3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:48.661222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff23e1c-71ce-40a6-9632-a3af5ec8c3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.662128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23e1c-71ce-40a6-9632-a3af5ec8c3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:48.664387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff23e1c-71ce-40a6-9632-a3af5ec8c3a2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:48.741101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a26daa-d9a6-4d6a-a157-99ce2b5e48f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:48.743953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26daa-d9a6-4d6a-a157-99ce2b5e48f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:48.743953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26daa-d9a6-4d6a-a157-99ce2b5e48f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:48.743953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a26daa-d9a6-4d6a-a157-99ce2b5e48f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.744298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a26daa-d9a6-4d6a-a157-99ce2b5e48f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:48.746553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a26daa-d9a6-4d6a-a157-99ce2b5e48f5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:48.801607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 837/1670] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:48 2022] POST /identity/v3/users => generated 286 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:48.809938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94d0a3-f857-4a42-aa3d-6b77c3f8854a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:48.810315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94d0a3-f857-4a42-aa3d-6b77c3f8854a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:48.810585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94d0a3-f857-4a42-aa3d-6b77c3f8854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.841153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4d94d0a3-f857-4a42-aa3d-6b77c3f8854a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:48.842564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4d94d0a3-f857-4a42-aa3d-6b77c3f8854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:48.861804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 838/1671] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:48.863265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94d0a3-f857-4a42-aa3d-6b77c3f8854a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:48.893952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 834/1672] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:48 2022] POST /identity/v3/projects => generated 371 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:48.896666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e4a3-f08a-4acd-aedd-95374a076e56 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:48.896995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94d0a3-f857-4a42-aa3d-6b77c3f8854a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:48.898093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e4a3-f08a-4acd-aedd-95374a076e56 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:48.900273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56e4a3-f08a-4acd-aedd-95374a076e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:48.980785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9a56e4a3-f08a-4acd-aedd-95374a076e56 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:48.986593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9a56e4a3-f08a-4acd-aedd-95374a076e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:49.114213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:49.114810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:49.115096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:49.115372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:49.118309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:49.120214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:49.159596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 839/1673] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:49.159596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:49.159596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:49.183628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 835/1674] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:49.183628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56e4a3-f08a-4acd-aedd-95374a076e56 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:49.206150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd8fa5-f4c5-412c-b076-7c8d2b49fa77 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:49.213650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a56e4a3-f08a-4acd-aedd-95374a076e56 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:49.218735 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674750-0287-4479-8f28-6e5d81d4a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:49.219376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674750-0287-4479-8f28-6e5d81d4a116 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:49.219684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674750-0287-4479-8f28-6e5d81d4a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:49.223266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674750-0287-4479-8f28-6e5d81d4a116 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:49.230292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90674750-0287-4479-8f28-6e5d81d4a116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:49.230428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e46c2-3250-4318-a4f5-22a129e1ed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:49.230428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e46c2-3250-4318-a4f5-22a129e1ed62 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:49.230428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e46c2-3250-4318-a4f5-22a129e1ed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:49.230428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e46c2-3250-4318-a4f5-22a129e1ed62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:49.230696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e46c2-3250-4318-a4f5-22a129e1ed62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:49.231796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e46c2-3250-4318-a4f5-22a129e1ed62 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:49.234501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90674750-0287-4479-8f28-6e5d81d4a116 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:49.261593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 836/1675] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:49.262485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e46c2-3250-4318-a4f5-22a129e1ed62 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:49.284799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e46c2-3250-4318-a4f5-22a129e1ed62 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:49.290244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:49.290871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:49.291162 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:49.291435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:49.292195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:49.292468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:49.294087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:49.312695 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 837/1676] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:49.313728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:49.325830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba97bb1-4e8b-45e6-bb1f-9fb3923888e5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:49.331469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce96904-7019-4061-ba27-87397f8902d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:49.332629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96904-7019-4061-ba27-87397f8902d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:49.335225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96904-7019-4061-ba27-87397f8902d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:49.339205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce96904-7019-4061-ba27-87397f8902d6 admin admin] PATH_INFO: `/v3/projects/6054812353204170b8525ead24111323/users/9d3ee77a42b04678b662e66e72b7691b/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:49.342757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 840/1677] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:49 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:49.350225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674750-0287-4479-8f28-6e5d81d4a116 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:49.365268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674750-0287-4479-8f28-6e5d81d4a116 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:49.370093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:49.375013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce96904-7019-4061-ba27-87397f8902d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6054812353204170b8525ead24111323, user_id=9d3ee77a42b04678b662e66e72b7691b, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:49.378397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce96904-7019-4061-ba27-87397f8902d6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:49.384547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69813b1c-90ba-475a-9c94-b56338c63cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:49.386014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69813b1c-90ba-475a-9c94-b56338c63cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:49.386522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69813b1c-90ba-475a-9c94-b56338c63cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:49.387010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69813b1c-90ba-475a-9c94-b56338c63cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:49.388192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69813b1c-90ba-475a-9c94-b56338c63cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:49.390730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69813b1c-90ba-475a-9c94-b56338c63cf1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:49.469720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 838/1678] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:49 2022] PUT /identity/v3/projects/6054812353204170b8525ead24111323/users/9d3ee77a42b04678b662e66e72b7691b/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:49.481602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce96904-7019-4061-ba27-87397f8902d6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:49.513704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 841/1679] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:49 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:49.520131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e21d0-4d6c-4a0f-a1f1-9f97c428a061 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:49.520850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e21d0-4d6c-4a0f-a1f1-9f97c428a061 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:49.522963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e21d0-4d6c-4a0f-a1f1-9f97c428a061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:49.554416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:49.641708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6a2e21d0-4d6c-4a0f-a1f1-9f97c428a061 None None] MFA Rules not processed for user `9d3ee77a42b04678b662e66e72b7691b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:49.643435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6a2e21d0-4d6c-4a0f-a1f1-9f97c428a061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:49.669740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce96904-7019-4061-ba27-87397f8902d6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:49.836793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 842/1680] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:49.861707 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e21d0-4d6c-4a0f-a1f1-9f97c428a061 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:49.882303 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:49.883193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:49.883598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:49.884081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:49.884856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:49.886505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:49.904386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 839/1681] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:49.904386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:49.907560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:50.068119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfd8c1-082a-41e8-83f9-150b5e3b59a3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:50.076862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235a806-629d-48a3-86e8-c8bf93b7bec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:50.080550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235a806-629d-48a3-86e8-c8bf93b7bec6 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.080550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235a806-629d-48a3-86e8-c8bf93b7bec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.080550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235a806-629d-48a3-86e8-c8bf93b7bec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.088395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e21d0-4d6c-4a0f-a1f1-9f97c428a061 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:50.095272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6197-ea93-4c19-a7a2-ad58063c6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:50.095941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6197-ea93-4c19-a7a2-ad58063c6ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.096911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6197-ea93-4c19-a7a2-ad58063c6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.097195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc6197-ea93-4c19-a7a2-ad58063c6ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.098451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc6197-ea93-4c19-a7a2-ad58063c6ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:50.101281 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235a806-629d-48a3-86e8-c8bf93b7bec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:50.102402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc6197-ea93-4c19-a7a2-ad58063c6ce6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:50.103555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235a806-629d-48a3-86e8-c8bf93b7bec6 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:50.124211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 840/1682] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:50.125632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235a806-629d-48a3-86e8-c8bf93b7bec6 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:50.147992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235a806-629d-48a3-86e8-c8bf93b7bec6 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:50.163274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc471e-ec1c-4da1-ac6e-7dc18778fcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:50.163736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc471e-ec1c-4da1-ac6e-7dc18778fcdc admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.164192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc471e-ec1c-4da1-ac6e-7dc18778fcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.164593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc471e-ec1c-4da1-ac6e-7dc18778fcdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.165519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc471e-ec1c-4da1-ac6e-7dc18778fcdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:50.169773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc471e-ec1c-4da1-ac6e-7dc18778fcdc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:50.183656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 841/1683] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:50.184804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc471e-ec1c-4da1-ac6e-7dc18778fcdc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:50.203280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc471e-ec1c-4da1-ac6e-7dc18778fcdc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:50.214766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:50.214766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.214766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.214766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] PATH_INFO: `/v3/users/9d3ee77a42b04678b662e66e72b7691b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.215173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3ee77a42b04678b662e66e72b7691b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:50.217163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:50.258759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 843/1684] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:49 2022] POST /identity/v3/users => generated 291 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:50.260287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6197-ea93-4c19-a7a2-ad58063c6ce6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:50.301445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc6197-ea93-4c19-a7a2-ad58063c6ce6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:50.307875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243420a1-027c-40e3-90aa-680cca579d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:50.308861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243420a1-027c-40e3-90aa-680cca579d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.309539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243420a1-027c-40e3-90aa-680cca579d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.310165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243420a1-027c-40e3-90aa-680cca579d6e admin admin] PATH_INFO: `/v3/projects/e00903a737274c4d8bc70edc0b6887ae/users/ee1069f0ab174be99b19e00f9bf6cbc6/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.330114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243420a1-027c-40e3-90aa-680cca579d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00903a737274c4d8bc70edc0b6887ae, user_id=ee1069f0ab174be99b19e00f9bf6cbc6, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:50.337144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243420a1-027c-40e3-90aa-680cca579d6e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:50.483659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 844/1685] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:50 2022] PUT /identity/v3/projects/e00903a737274c4d8bc70edc0b6887ae/users/ee1069f0ab174be99b19e00f9bf6cbc6/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:50.484998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243420a1-027c-40e3-90aa-680cca579d6e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:50.500573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3ee77a42b04678b662e66e72b7691b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:50.501375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3ee77a42b04678b662e66e72b7691b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:50.661019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243420a1-027c-40e3-90aa-680cca579d6e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:50.671283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:50.672304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.673284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.673711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.675608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:50.680983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:50.693960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3ee77a42b04678b662e66e72b7691b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:50.694619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3ee77a42b04678b662e66e72b7691b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:50.704825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 845/1686] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:50.707078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:50.710570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:50.717684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4c721659-9ff1-4cdd-9676-10b21dd8386c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3ee77a42b04678b662e66e72b7691b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:50.732143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc9c76-5d06-4aa8-8e3f-f281ec60602b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:50.732499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 842/1687] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:17:50 2022] DELETE /identity/v3/users/9d3ee77a42b04678b662e66e72b7691b => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:50.733976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e900b-60a1-4caf-8b0b-d89c00842075 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.734271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e900b-60a1-4caf-8b0b-d89c00842075 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.734588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e900b-60a1-4caf-8b0b-d89c00842075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.768839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c62e900b-60a1-4caf-8b0b-d89c00842075 None None] MFA Rules not processed for user `ee1069f0ab174be99b19e00f9bf6cbc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:50.770199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c62e900b-60a1-4caf-8b0b-d89c00842075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:50.854799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 843/1688] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:50.855901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e900b-60a1-4caf-8b0b-d89c00842075 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:50.857571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c62e900b-60a1-4caf-8b0b-d89c00842075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:50.864315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:50.865884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.866495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.867498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] PATH_INFO: `/v3/projects/e2f9dec4cea242238a31f2fab8075032` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.869022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2f9dec4cea242238a31f2fab8075032)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:50.875187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:50.875325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e900b-60a1-4caf-8b0b-d89c00842075 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:50.877187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:50.880536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b9a50-b409-4851-b4fa-714e5428886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:50.881361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b9a50-b409-4851-b4fa-714e5428886d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.881655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b9a50-b409-4851-b4fa-714e5428886d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.881938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b9a50-b409-4851-b4fa-714e5428886d admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.882601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b9a50-b409-4851-b4fa-714e5428886d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:50.886269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b9a50-b409-4851-b4fa-714e5428886d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:50.907547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 844/1689] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:50.907547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661c80-e150-418f-bb64-d060d7362ae0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.907547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661c80-e150-418f-bb64-d060d7362ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.907547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661c80-e150-418f-bb64-d060d7362ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.944673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3f661c80-e150-418f-bb64-d060d7362ae0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:50.945967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3f661c80-e150-418f-bb64-d060d7362ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:50.955015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 845/1690] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:50.957678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63362-a96c-46f2-934b-e0609a210a98 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:50.957678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63362-a96c-46f2-934b-e0609a210a98 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:50.957678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa63362-a96c-46f2-934b-e0609a210a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:50.991520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9fa63362-a96c-46f2-934b-e0609a210a98 None None] MFA Rules not processed for user `303d742b77ed4eb798b7f28117b89c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:50.993206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9fa63362-a96c-46f2-934b-e0609a210a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:51.054737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2f9dec4cea242238a31f2fab8075032', 'request_id': 'req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:51.102817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 846/1691] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:51.103501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63362-a96c-46f2-934b-e0609a210a98 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:51.105092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9fa63362-a96c-46f2-934b-e0609a210a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:51.122136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa63362-a96c-46f2-934b-e0609a210a98 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:51.138998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2f9dec4cea242238a31f2fab8075032', 'request_id': 'req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:51.147065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2f9dec4cea242238a31f2fab8075032', 'request_id': 'req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:51.174063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] The token cache is being invalidate because project e2f9dec4cea242238a31f2fab8075032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:17:51.174234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:51.174967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:51.180317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 846/1692] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:17:50 2022] DELETE /identity/v3/projects/e2f9dec4cea242238a31f2fab8075032 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:51.180549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:51.183084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:51.260406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:51.261045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:51.261330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:51.261607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:51.262251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:51.264221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:51.319711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ec0f-5215-4e08-8dd8-3d834fb254cb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:51.324630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2655cf-2e44-47c1-b86b-fab3bbf64ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:51.325323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2655cf-2e44-47c1-b86b-fab3bbf64ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:51.326445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2655cf-2e44-47c1-b86b-fab3bbf64ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:51.326445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2655cf-2e44-47c1-b86b-fab3bbf64ec4 admin admin] PATH_INFO: `/v3/projects/0f86e2480d6f49b087811ba4ed6ac842/users/8fd7989e31db4c20808f565104c271a0/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:51.344414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2655cf-2e44-47c1-b86b-fab3bbf64ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f86e2480d6f49b087811ba4ed6ac842, user_id=8fd7989e31db4c20808f565104c271a0, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:51.347165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2655cf-2e44-47c1-b86b-fab3bbf64ec4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:51.351905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:51.433761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 847/1693] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:51 2022] POST /identity/v3/projects => generated 373 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:51.433761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:51.433761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:51.491995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 847/1694] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:51 2022] PUT /identity/v3/projects/0f86e2480d6f49b087811ba4ed6ac842/users/8fd7989e31db4c20808f565104c271a0/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:51.491995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71247-9cdf-4330-b25a-6f2ea8c086b9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:51.491995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71247-9cdf-4330-b25a-6f2ea8c086b9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:51.491995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab71247-9cdf-4330-b25a-6f2ea8c086b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:51.553104 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bab71247-9cdf-4330-b25a-6f2ea8c086b9 None None] MFA Rules not processed for user `303d742b77ed4eb798b7f28117b89c75`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:51.561757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bab71247-9cdf-4330-b25a-6f2ea8c086b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:51.645676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ae5c9-8299-4351-8b2b-5ff5f7d8d57f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:51.755900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 848/1695] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:51.760746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc62308-0d7a-4a0f-9274-3047be029b01 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:51.761098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc62308-0d7a-4a0f-9274-3047be029b01 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:51.761393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc62308-0d7a-4a0f-9274-3047be029b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:51.806028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:51.807057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:51.807423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:51.807793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:51.813485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:51.823205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-acc62308-0d7a-4a0f-9274-3047be029b01 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:51.825235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-acc62308-0d7a-4a0f-9274-3047be029b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:51.962813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:51.965013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:51.980727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 848/1696] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:51.981886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:51.984411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:52.004749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627cefab-0529-47be-9b11-6a97e31e7c9c service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:52.014318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:52.015356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.015925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.016422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.019243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:52.024001 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:52.071190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 849/1697] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:52.080383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a669c8-4e9a-4468-ba95-ab675eba20fa None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.080721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a669c8-4e9a-4468-ba95-ab675eba20fa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.084042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a669c8-4e9a-4468-ba95-ab675eba20fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.220249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 849/1698] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:51 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:52.220861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-71a669c8-4e9a-4468-ba95-ab675eba20fa None None] MFA Rules not processed for user `8fd7989e31db4c20808f565104c271a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:52.220955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:52.221408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-71a669c8-4e9a-4468-ba95-ab675eba20fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:52.224057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:52.424095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 850/1699] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:52.425028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd47a-a87f-4d5d-9480-eb8628bd4edf None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.425402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd47a-a87f-4d5d-9480-eb8628bd4edf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.425802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd47a-a87f-4d5d-9480-eb8628bd4edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.499131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ccadd47a-a87f-4d5d-9480-eb8628bd4edf None None] MFA Rules not processed for user `c7f5fe359aca4be3a2e609465298d637`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:52.500631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ccadd47a-a87f-4d5d-9480-eb8628bd4edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:52.506619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c66956-5430-4552-a3ba-8f20b0b6d3c2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:52.539815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e71a2e-26d0-43f5-9ac4-e58c258b6a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:52.541775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e71a2e-26d0-43f5-9ac4-e58c258b6a53 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.542066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e71a2e-26d0-43f5-9ac4-e58c258b6a53 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.542347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e71a2e-26d0-43f5-9ac4-e58c258b6a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.550017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-44e71a2e-26d0-43f5-9ac4-e58c258b6a53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:52.586828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e71a2e-26d0-43f5-9ac4-e58c258b6a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:52.591362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e71a2e-26d0-43f5-9ac4-e58c258b6a53 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:52.645145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 850/1700] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:52.649235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a171f-bc73-4185-94b4-22c05784f27c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.650643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a171f-bc73-4185-94b4-22c05784f27c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.650643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a171f-bc73-4185-94b4-22c05784f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.670858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:52.688155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 851/1701] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:52.688768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadd47a-a87f-4d5d-9480-eb8628bd4edf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:52.721164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadd47a-a87f-4d5d-9480-eb8628bd4edf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:52.739776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:52.740647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.741089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.741522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.742503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:52.744316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:52.749522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-011a171f-bc73-4185-94b4-22c05784f27c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:52.757346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-011a171f-bc73-4185-94b4-22c05784f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:52.778994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 851/1702] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:52.788184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a171f-bc73-4185-94b4-22c05784f27c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:52.788411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 852/1703] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:52.788742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:52.807168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:52.813524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a171f-bc73-4185-94b4-22c05784f27c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:52.818113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea8b8-d808-489a-a9d4-27ff24c96e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:52.819821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea8b8-d808-489a-a9d4-27ff24c96e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.820310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea8b8-d808-489a-a9d4-27ff24c96e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.820961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fea8b8-d808-489a-a9d4-27ff24c96e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.821905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fea8b8-d808-489a-a9d4-27ff24c96e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:52.824381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fea8b8-d808-489a-a9d4-27ff24c96e03 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:52.852542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b70bceb-113d-4ced-8a5f-5fea9be1c060 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:52.874816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6686188-05fc-47bc-9acb-5886d4071d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:52.876005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686188-05fc-47bc-9acb-5886d4071d1c service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:52.882307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686188-05fc-47bc-9acb-5886d4071d1c service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:52.882307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686188-05fc-47bc-9acb-5886d4071d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:52.897739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6686188-05fc-47bc-9acb-5886d4071d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:52.899385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6686188-05fc-47bc-9acb-5886d4071d1c service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:52.929006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 853/1704] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:52.929850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6686188-05fc-47bc-9acb-5886d4071d1c service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:52.969394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 852/1705] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:52 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:52.969394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea8b8-d808-489a-a9d4-27ff24c96e03 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:52.970278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6686188-05fc-47bc-9acb-5886d4071d1c service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:53.052298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:53.117562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fea8b8-d808-489a-a9d4-27ff24c96e03 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:53.124970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad417a5d-004c-4339-a1be-6b5627e76490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:53.126324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad417a5d-004c-4339-a1be-6b5627e76490 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.127740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad417a5d-004c-4339-a1be-6b5627e76490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.128624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:53.129218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad417a5d-004c-4339-a1be-6b5627e76490 admin admin] PATH_INFO: `/v3/projects/0453767a5e8740a4afcfd105562f393f/users/8ec2b77aee784c64bacb2eb2724cacfd/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.130671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.131364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.135375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.137215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:53.138614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:53.142791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:53.166741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 853/1706] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:53.168349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:53.173592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad417a5d-004c-4339-a1be-6b5627e76490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0453767a5e8740a4afcfd105562f393f, user_id=8ec2b77aee784c64bacb2eb2724cacfd, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:53.177107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:53.179511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad417a5d-004c-4339-a1be-6b5627e76490 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:53.200732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbe81-d6a3-4ade-a497-465a7debee31 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:53.206724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:53.208327 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.208863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.209337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] PATH_INFO: `/v3/projects/6054812353204170b8525ead24111323` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.212269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6054812353204170b8525ead24111323)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:53.216875 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:53.277242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 854/1707] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:52 2022] PUT /identity/v3/projects/0453767a5e8740a4afcfd105562f393f/users/8ec2b77aee784c64bacb2eb2724cacfd/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:53.277242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad417a5d-004c-4339-a1be-6b5627e76490 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:53.470663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad417a5d-004c-4339-a1be-6b5627e76490 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:53.476840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6054812353204170b8525ead24111323', 'request_id': 'req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:53.614278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6054812353204170b8525ead24111323', 'request_id': 'req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:53.624373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6054812353204170b8525ead24111323', 'request_id': 'req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:53.628649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:53.632318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.632605 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.632883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.633542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:53.635496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:53.658021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] The token cache is being invalidate because project 6054812353204170b8525ead24111323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:17:53.658618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:53.659475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:17:53.664595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 854/1708] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:17:53 2022] DELETE /identity/v3/projects/6054812353204170b8525ead24111323 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:53.665790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:53.670380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:53.705037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7798b31-b30b-4a4b-b2f6-ecb3c1b353c3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:53.725190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb299f5-5b02-4123-b994-dc2276d0907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:53.728384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb299f5-5b02-4123-b994-dc2276d0907e admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.728850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb299f5-5b02-4123-b994-dc2276d0907e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.729373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb299f5-5b02-4123-b994-dc2276d0907e admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.730762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb299f5-5b02-4123-b994-dc2276d0907e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:53.733062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb299f5-5b02-4123-b994-dc2276d0907e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:53.765016 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 855/1709] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:53 2022] POST /identity/v3/users => generated 296 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:53.769067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:53.780068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:53.796693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ebc1e-4bf6-42a6-b922-2001956aa21c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:53.809129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62d315a-ccf4-4406-80d6-bc698dbc4489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:53.809929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d315a-ccf4-4406-80d6-bc698dbc4489 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.810314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d315a-ccf4-4406-80d6-bc698dbc4489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.810800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62d315a-ccf4-4406-80d6-bc698dbc4489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.812002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d315a-ccf4-4406-80d6-bc698dbc4489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:53.814189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62d315a-ccf4-4406-80d6-bc698dbc4489 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:53.831835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 856/1710] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:53.834357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe30c2-8f11-4b48-a896-e69ea34fac5d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:53.835400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe30c2-8f11-4b48-a896-e69ea34fac5d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:53.835691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe30c2-8f11-4b48-a896-e69ea34fac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:53.861367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-47fe30c2-8f11-4b48-a896-e69ea34fac5d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:53.863088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-47fe30c2-8f11-4b48-a896-e69ea34fac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:53.879996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 857/1711] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:53.906357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe30c2-8f11-4b48-a896-e69ea34fac5d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:53.911328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-47fe30c2-8f11-4b48-a896-e69ea34fac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:53.926975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 855/1712] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:53 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:53.926975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb299f5-5b02-4123-b994-dc2276d0907e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:53.948601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe30c2-8f11-4b48-a896-e69ea34fac5d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:54.037266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaaf14-b93a-4508-b7eb-079b4d15dc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:54.037898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaaf14-b93a-4508-b7eb-079b4d15dc41 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.038227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaaf14-b93a-4508-b7eb-079b4d15dc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.038452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaaf14-b93a-4508-b7eb-079b4d15dc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.039112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaaf14-b93a-4508-b7eb-079b4d15dc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:54.041326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaaf14-b93a-4508-b7eb-079b4d15dc41 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:54.068874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 858/1713] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:54.069580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33f0d-e0d9-43b1-8c12-ea265f1534b4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.070314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33f0d-e0d9-43b1-8c12-ea265f1534b4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.070603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33f0d-e0d9-43b1-8c12-ea265f1534b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.073103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb299f5-5b02-4123-b994-dc2276d0907e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:54.084883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1693714-ce6e-4bcd-8a47-a86c1b8829c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:54.085657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693714-ce6e-4bcd-8a47-a86c1b8829c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.085836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693714-ce6e-4bcd-8a47-a86c1b8829c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.086120 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1693714-ce6e-4bcd-8a47-a86c1b8829c4 admin admin] PATH_INFO: `/v3/projects/0453767a5e8740a4afcfd105562f393f/users/8ec2b77aee784c64bacb2eb2724cacfd/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.093245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1693714-ce6e-4bcd-8a47-a86c1b8829c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0453767a5e8740a4afcfd105562f393f, user_id=8ec2b77aee784c64bacb2eb2724cacfd, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:54.095906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1693714-ce6e-4bcd-8a47-a86c1b8829c4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:54.121590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-cab33f0d-e0d9-43b1-8c12-ea265f1534b4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:54.131083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cab33f0d-e0d9-43b1-8c12-ea265f1534b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:54.137270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 856/1714] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:53 2022] PUT /identity/v3/projects/0453767a5e8740a4afcfd105562f393f/users/8ec2b77aee784c64bacb2eb2724cacfd/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:54.140619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b79b-edda-4a11-885d-da53357d1ff4 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.140915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b79b-edda-4a11-885d-da53357d1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.141199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b79b-edda-4a11-885d-da53357d1ff4 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.152209 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 857/1715] 10.222.0.82 () {54 vars in 912 bytes} [Mon Aug 29 19:17:54 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:17:54.153230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7b79b-edda-4a11-885d-da53357d1ff4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:54.228909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:54.309359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 859/1716] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:54.310475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab33f0d-e0d9-43b1-8c12-ea265f1534b4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:54.314466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7b79b-edda-4a11-885d-da53357d1ff4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:54.329589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ccf75-2901-40a2-a9a5-e06cd92542e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:54.330619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ccf75-2901-40a2-a9a5-e06cd92542e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.330939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab33f0d-e0d9-43b1-8c12-ea265f1534b4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:54.331612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ccf75-2901-40a2-a9a5-e06cd92542e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.333061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ccf75-2901-40a2-a9a5-e06cd92542e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.335305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ccf75-2901-40a2-a9a5-e06cd92542e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:54.339392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ccf75-2901-40a2-a9a5-e06cd92542e3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:54.344603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620212f-c1f1-45ed-b338-537b40b38ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:54.345624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620212f-c1f1-45ed-b338-537b40b38ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.346071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620212f-c1f1-45ed-b338-537b40b38ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.346512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620212f-c1f1-45ed-b338-537b40b38ae6 admin admin] PATH_INFO: `/v3/projects/7a2c298eefef4806b94eb63e9ed99963/users/cc7778bee09744a0ac3ae75cb28911b5/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.369646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620212f-c1f1-45ed-b338-537b40b38ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2c298eefef4806b94eb63e9ed99963, user_id=cc7778bee09744a0ac3ae75cb28911b5, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:54.372878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620212f-c1f1-45ed-b338-537b40b38ae6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:54.505028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 860/1717] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:54 2022] PUT /identity/v3/projects/7a2c298eefef4806b94eb63e9ed99963/users/cc7778bee09744a0ac3ae75cb28911b5/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:54.506748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d6620-3c16-4981-9c48-80814008bb02 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.507381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d6620-3c16-4981-9c48-80814008bb02 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.507597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d6620-3c16-4981-9c48-80814008bb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.553542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 858/1718] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:54 2022] POST /identity/v3/users => generated 287 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:54.554861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17376bc-9548-4ea8-a2f1-aa303a2db2ff None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.561042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17376bc-9548-4ea8-a2f1-aa303a2db2ff None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.561513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17376bc-9548-4ea8-a2f1-aa303a2db2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-a17376bc-9548-4ea8-a2f1-aa303a2db2ff None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:17:54.609994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:17:54.610898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:17:54.622277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 859/1719] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:17:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:17:54.626825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17376bc-9548-4ea8-a2f1-aa303a2db2ff None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:54.639941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-378d6620-3c16-4981-9c48-80814008bb02 None None] MFA Rules not processed for user `8ec2b77aee784c64bacb2eb2724cacfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:54.663232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-378d6620-3c16-4981-9c48-80814008bb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:54.676486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:54.857803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 861/1720] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:54.858565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d6620-3c16-4981-9c48-80814008bb02 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:54.934651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17376bc-9548-4ea8-a2f1-aa303a2db2ff None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:54.952692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:54.953311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:54.953595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:54.953961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:54.954657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:17:54.955304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:54.958977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:54.994730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 860/1721] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:17:55.002497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:55.018651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d56b30-9469-43e6-aebc-8b5c063261a7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:55.042138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:55.042138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.042138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.042138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.042403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:55.043643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:55.057104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 861/1722] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:55.058607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:55.097714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:55.123496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d6620-3c16-4981-9c48-80814008bb02 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:55.142773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4a027-eb30-4d18-90f6-67d5c626adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:55.144272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4a027-eb30-4d18-90f6-67d5c626adcf admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.145763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4a027-eb30-4d18-90f6-67d5c626adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.149101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4a027-eb30-4d18-90f6-67d5c626adcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.150255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4a027-eb30-4d18-90f6-67d5c626adcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:55.155829 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4a027-eb30-4d18-90f6-67d5c626adcf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:55.181931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 862/1723] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:55.183141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4a027-eb30-4d18-90f6-67d5c626adcf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:55.210271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4a027-eb30-4d18-90f6-67d5c626adcf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:55.220649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7b0d2-a11e-465b-9285-c3e2c6a50b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:55.226541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b0d2-a11e-465b-9285-c3e2c6a50b67 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.229938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b0d2-a11e-465b-9285-c3e2c6a50b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.230969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7b0d2-a11e-465b-9285-c3e2c6a50b67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.263413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7b0d2-a11e-465b-9285-c3e2c6a50b67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:55.269112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7b0d2-a11e-465b-9285-c3e2c6a50b67 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:55.298660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81835d-4f35-48c9-a67a-2e3110ce93e9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:55.309562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d241438-c4a8-4dde-9e0e-6c17b62fe1b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:55.310260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241438-c4a8-4dde-9e0e-6c17b62fe1b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.310496 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241438-c4a8-4dde-9e0e-6c17b62fe1b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.310825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d241438-c4a8-4dde-9e0e-6c17b62fe1b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.343172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d241438-c4a8-4dde-9e0e-6c17b62fe1b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:55.347378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d241438-c4a8-4dde-9e0e-6c17b62fe1b1 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:55.369879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:55.388694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 862/1724] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:55.394356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d241438-c4a8-4dde-9e0e-6c17b62fe1b1 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:55.427959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d241438-c4a8-4dde-9e0e-6c17b62fe1b1 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:55.428099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 863/1725] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:55 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:55.428099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7b0d2-a11e-465b-9285-c3e2c6a50b67 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:55.649883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b061a57-90de-49c8-b8a9-2b0be3b7ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:55.650590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061a57-90de-49c8-b8a9-2b0be3b7ad09 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.652187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061a57-90de-49c8-b8a9-2b0be3b7ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.652491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b061a57-90de-49c8-b8a9-2b0be3b7ad09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.653424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b061a57-90de-49c8-b8a9-2b0be3b7ad09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:55.655394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b061a57-90de-49c8-b8a9-2b0be3b7ad09 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:55.658036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7b0d2-a11e-465b-9285-c3e2c6a50b67 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:55.669132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041332-cd47-4551-9a3d-af0ef9ad5904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:55.669812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041332-cd47-4551-9a3d-af0ef9ad5904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.670096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041332-cd47-4551-9a3d-af0ef9ad5904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.670376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86041332-cd47-4551-9a3d-af0ef9ad5904 admin admin] PATH_INFO: `/v3/projects/7a2c298eefef4806b94eb63e9ed99963/users/cc7778bee09744a0ac3ae75cb28911b5/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.674241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86041332-cd47-4551-9a3d-af0ef9ad5904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2c298eefef4806b94eb63e9ed99963, user_id=cc7778bee09744a0ac3ae75cb28911b5, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:55.678800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86041332-cd47-4551-9a3d-af0ef9ad5904 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:55.685082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 863/1726] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:55.686580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210803a-0338-47d3-81f2-7e774130825d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.688276 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210803a-0338-47d3-81f2-7e774130825d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.688519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210803a-0338-47d3-81f2-7e774130825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.709093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 864/1727] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:55 2022] PUT /identity/v3/projects/7a2c298eefef4806b94eb63e9ed99963/users/cc7778bee09744a0ac3ae75cb28911b5/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:55.709723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041332-cd47-4551-9a3d-af0ef9ad5904 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:55.743343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3210803a-0338-47d3-81f2-7e774130825d None None] MFA Rules not processed for user `f534257027f34264bedd3d148ed37fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:55.745014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3210803a-0338-47d3-81f2-7e774130825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:55.880210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 864/1728] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:55.881791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dc1b7-ac29-4523-b8bd-33df357f6ce4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.882080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dc1b7-ac29-4523-b8bd-33df357f6ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.882364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dc1b7-ac29-4523-b8bd-33df357f6ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.898520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86041332-cd47-4551-9a3d-af0ef9ad5904 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:55.911182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dd29f-f80c-46e7-b8d9-48a3eccd79a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:55.912026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd29f-f80c-46e7-b8d9-48a3eccd79a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:55.912408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd29f-f80c-46e7-b8d9-48a3eccd79a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:55.912745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd29f-f80c-46e7-b8d9-48a3eccd79a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:55.914853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a83dc1b7-ac29-4523-b8bd-33df357f6ce4 None None] MFA Rules not processed for user `831190b97d2c4f36bfbaaf444ff20ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:55.916115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a83dc1b7-ac29-4523-b8bd-33df357f6ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:55.918263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dd29f-f80c-46e7-b8d9-48a3eccd79a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:55.920873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dd29f-f80c-46e7-b8d9-48a3eccd79a9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:56.027927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 865/1729] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:56.034317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dc1b7-ac29-4523-b8bd-33df357f6ce4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:56.055419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 865/1730] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:55 2022] POST /identity/v3/users => generated 288 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:56.056785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a3c3-7e0e-45e3-880d-8117cdc606e9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:56.057078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a3c3-7e0e-45e3-880d-8117cdc606e9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:56.057359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a3c3-7e0e-45e3-880d-8117cdc606e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:56.067710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83dc1b7-ac29-4523-b8bd-33df357f6ce4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:56.083075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea62dc2-bec8-4da6-b983-0b65bea0efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:56.083793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea62dc2-bec8-4da6-b983-0b65bea0efc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:56.084077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea62dc2-bec8-4da6-b983-0b65bea0efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:56.084349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea62dc2-bec8-4da6-b983-0b65bea0efc0 admin admin] PATH_INFO: `/v3/projects/bbf15070c76a46ddb9e4730222f5d1e6/users/3a901052284c4bb68bfbf2077f58c9c3/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:56.123252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea62dc2-bec8-4da6-b983-0b65bea0efc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf15070c76a46ddb9e4730222f5d1e6, user_id=3a901052284c4bb68bfbf2077f58c9c3, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:56.133512 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea62dc2-bec8-4da6-b983-0b65bea0efc0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:56.134669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-23c9a3c3-7e0e-45e3-880d-8117cdc606e9 None None] MFA Rules not processed for user `cc7778bee09744a0ac3ae75cb28911b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:56.137548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-23c9a3c3-7e0e-45e3-880d-8117cdc606e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:56.235919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 866/1731] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:56 2022] PUT /identity/v3/projects/bbf15070c76a46ddb9e4730222f5d1e6/users/3a901052284c4bb68bfbf2077f58c9c3/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:56.235919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea62dc2-bec8-4da6-b983-0b65bea0efc0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:56.274438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:56.366847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 866/1732] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:56.367968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026956-b2c8-42ae-9b55-a97557f63b99 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:56.368254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026956-b2c8-42ae-9b55-a97557f63b99 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:56.368530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf026956-b2c8-42ae-9b55-a97557f63b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:56.410453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea62dc2-bec8-4da6-b983-0b65bea0efc0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:56.426252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:56.427270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:56.427373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bf026956-b2c8-42ae-9b55-a97557f63b99 None None] MFA Rules not processed for user `f534257027f34264bedd3d148ed37fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:56.427889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:56.428360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:56.432773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bf026956-b2c8-42ae-9b55-a97557f63b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:56.438814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:56.595770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 867/1733] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:56.595770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf026956-b2c8-42ae-9b55-a97557f63b99 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:56.597418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bf026956-b2c8-42ae-9b55-a97557f63b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:56.651088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:56.653494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:56.700664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 867/1734] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:56.705579 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:56.760157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:56.819174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf026956-b2c8-42ae-9b55-a97557f63b99 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:56.827273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:56.829015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:56.829514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:56.837348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:56.915584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340c5f-44d7-4184-aa25-7ad57a822db7 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:56.926183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec008338-bb75-40d5-a03d-ea0dd7f3466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:56.927756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008338-bb75-40d5-a03d-ea0dd7f3466e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:56.928357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008338-bb75-40d5-a03d-ea0dd7f3466e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:56.928805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec008338-bb75-40d5-a03d-ea0dd7f3466e admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:56.936564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec008338-bb75-40d5-a03d-ea0dd7f3466e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:56.939458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec008338-bb75-40d5-a03d-ea0dd7f3466e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:56.957751 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:56.959639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:56.965991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 868/1735] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:56.967685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d90b6d-a7ab-4778-af11-63bff5f7c592 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:56.968238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d90b6d-a7ab-4778-af11-63bff5f7c592 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:56.969837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d90b6d-a7ab-4778-af11-63bff5f7c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:56.993544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 868/1736] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:56.995200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:57.000847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:57.026312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-59d90b6d-a7ab-4778-af11-63bff5f7c592 None None] MFA Rules not processed for user `3a901052284c4bb68bfbf2077f58c9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:57.028580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-59d90b6d-a7ab-4778-af11-63bff5f7c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:57.048727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929acf-a655-4615-bfe8-a5ea70a84cc5 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:57.061162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857cbb6-d62b-4cae-a2cb-a61014ac8aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:57.065459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857cbb6-d62b-4cae-a2cb-a61014ac8aca service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:57.067999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857cbb6-d62b-4cae-a2cb-a61014ac8aca service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:57.069892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857cbb6-d62b-4cae-a2cb-a61014ac8aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:57.212994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 869/1737] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:57.214033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d90b6d-a7ab-4778-af11-63bff5f7c592 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:57.215880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-59d90b6d-a7ab-4778-af11-63bff5f7c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:57.248495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d90b6d-a7ab-4778-af11-63bff5f7c592 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:57.252812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857cbb6-d62b-4cae-a2cb-a61014ac8aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:57.254859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857cbb6-d62b-4cae-a2cb-a61014ac8aca service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:57.255975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cce79-357f-4e59-a73c-163930bac715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:57.257023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cce79-357f-4e59-a73c-163930bac715 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:57.257711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cce79-357f-4e59-a73c-163930bac715 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:57.258141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cce79-357f-4e59-a73c-163930bac715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:57.269307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cce79-357f-4e59-a73c-163930bac715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:57.274744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cce79-357f-4e59-a73c-163930bac715 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:57.280611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 869/1738] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:57.282057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857cbb6-d62b-4cae-a2cb-a61014ac8aca service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:57.307491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857cbb6-d62b-4cae-a2cb-a61014ac8aca service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:57.313848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 870/1739] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:57.318708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cce79-357f-4e59-a73c-163930bac715 service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:57.321764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6c0da-c8ee-454a-a8ee-ebf1f6e644db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:57.323986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c0da-c8ee-454a-a8ee-ebf1f6e644db admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:57.324497 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c0da-c8ee-454a-a8ee-ebf1f6e644db admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:57.326370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6c0da-c8ee-454a-a8ee-ebf1f6e644db admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:57.328632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6c0da-c8ee-454a-a8ee-ebf1f6e644db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:57.338709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6c0da-c8ee-454a-a8ee-ebf1f6e644db admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:57.368286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cce79-357f-4e59-a73c-163930bac715 service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:57.372053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 870/1740] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:57.373588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6c0da-c8ee-454a-a8ee-ebf1f6e644db admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:57.388099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c94f1-41f0-4a39-b779-8182b1a3f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:57.388790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c94f1-41f0-4a39-b779-8182b1a3f246 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:57.389081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c94f1-41f0-4a39-b779-8182b1a3f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:57.392985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c94f1-41f0-4a39-b779-8182b1a3f246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:57.397607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6c0da-c8ee-454a-a8ee-ebf1f6e644db admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:57.414334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeddfd75-6b0a-4ef8-9052-18b617988128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:57.414565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c94f1-41f0-4a39-b779-8182b1a3f246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:57.416439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddfd75-6b0a-4ef8-9052-18b617988128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:57.418105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c94f1-41f0-4a39-b779-8182b1a3f246 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:57.419389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddfd75-6b0a-4ef8-9052-18b617988128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:57.419791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeddfd75-6b0a-4ef8-9052-18b617988128 admin admin] PATH_INFO: `/v3/projects/2bf9c11e19e54ae7afc4ff095733f537/users/7a019d05c5a146ca8613e1a4306ddcc5/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:57.470596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddfd75-6b0a-4ef8-9052-18b617988128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf9c11e19e54ae7afc4ff095733f537, user_id=7a019d05c5a146ca8613e1a4306ddcc5, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:57.480580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeddfd75-6b0a-4ef8-9052-18b617988128 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:57.596781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 871/1741] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:17:57 2022] POST /identity/v3/projects => generated 373 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:57.602292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c94f1-41f0-4a39-b779-8182b1a3f246 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:57.635472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 871/1742] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:57 2022] PUT /identity/v3/projects/2bf9c11e19e54ae7afc4ff095733f537/users/7a019d05c5a146ca8613e1a4306ddcc5/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:57.653772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c509594-bda6-42a7-aa4f-af8c515299d5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:57.654109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c509594-bda6-42a7-aa4f-af8c515299d5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:57.654362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c509594-bda6-42a7-aa4f-af8c515299d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:57.729851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6c509594-bda6-42a7-aa4f-af8c515299d5 None None] MFA Rules not processed for user `7a019d05c5a146ca8613e1a4306ddcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:57.732883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6c509594-bda6-42a7-aa4f-af8c515299d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:57.774497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c94f1-41f0-4a39-b779-8182b1a3f246 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:57.876059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533975c-4ae6-4c22-b053-cf5e6130f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:57.877010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533975c-4ae6-4c22-b053-cf5e6130f43a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:57.878452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533975c-4ae6-4c22-b053-cf5e6130f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:57.878856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533975c-4ae6-4c22-b053-cf5e6130f43a admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:57.881711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 872/1743] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:17:57.882634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c509594-bda6-42a7-aa4f-af8c515299d5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:57.889458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533975c-4ae6-4c22-b053-cf5e6130f43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:57.893613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533975c-4ae6-4c22-b053-cf5e6130f43a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:57.966210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c509594-bda6-42a7-aa4f-af8c515299d5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:57.970115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:57.970748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:57.971031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:57.971308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:57.973921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:58.041532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 872/1744] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:17:57 2022] POST /identity/v3/users => generated 293 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:17:58.042523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533975c-4ae6-4c22-b053-cf5e6130f43a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:58.062486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:58.080310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533975c-4ae6-4c22-b053-cf5e6130f43a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:58.091774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:58.094124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135e63-c2d4-46d2-8e54-57513fcba161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:58.094934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135e63-c2d4-46d2-8e54-57513fcba161 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.095426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135e63-c2d4-46d2-8e54-57513fcba161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.095996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a135e63-c2d4-46d2-8e54-57513fcba161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:58.098250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:58.116673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:58.124172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a135e63-c2d4-46d2-8e54-57513fcba161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:58.127026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a135e63-c2d4-46d2-8e54-57513fcba161 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:58.128945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 873/1745] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:58.134428 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:58.197153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 873/1746] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:17:58.198185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f9be-175d-469c-ad8a-9548492a3fec service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:58.217387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aac18-2d44-4da7-8a76-e7b93d50d90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:58.219543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aac18-2d44-4da7-8a76-e7b93d50d90d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.220087 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aac18-2d44-4da7-8a76-e7b93d50d90d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.220429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aac18-2d44-4da7-8a76-e7b93d50d90d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:58.221570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1aac18-2d44-4da7-8a76-e7b93d50d90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:58.233837 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1aac18-2d44-4da7-8a76-e7b93d50d90d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:58.291134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135e63-c2d4-46d2-8e54-57513fcba161 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:58.295224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 874/1747] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:58.308363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a135e63-c2d4-46d2-8e54-57513fcba161 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:58.327048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776c0c-234f-4044-842e-0c124d491b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:58.328024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776c0c-234f-4044-842e-0c124d491b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.328314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776c0c-234f-4044-842e-0c124d491b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.328597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776c0c-234f-4044-842e-0c124d491b83 admin admin] PATH_INFO: `/v3/projects/7e683c4a2b704c38917ea2678e37e90b/users/1249649cbc3544988a03e159b0ce9d5f/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:58.365237 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776c0c-234f-4044-842e-0c124d491b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e683c4a2b704c38917ea2678e37e90b, user_id=1249649cbc3544988a03e159b0ce9d5f, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:58.371086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776c0c-234f-4044-842e-0c124d491b83 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:58.427367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a540-c3ed-46af-97ba-ec2eed0c6231 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.427848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a540-c3ed-46af-97ba-ec2eed0c6231 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.428334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a540-c3ed-46af-97ba-ec2eed0c6231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-2be0a540-c3ed-46af-97ba-ec2eed0c6231 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:17:58.462809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:17:58.463660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:17:58.464665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 875/1748] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:17:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 40 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 19:17:58.500691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 874/1749] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:58 2022] PUT /identity/v3/projects/7e683c4a2b704c38917ea2678e37e90b/users/1249649cbc3544988a03e159b0ce9d5f/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:17:58.501835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0a540-c3ed-46af-97ba-ec2eed0c6231 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:58.732672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0a540-c3ed-46af-97ba-ec2eed0c6231 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:58.750955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091e6ab-a889-480b-a9fa-d683616bd3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:58.752993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091e6ab-a889-480b-a9fa-d683616bd3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.753615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091e6ab-a889-480b-a9fa-d683616bd3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.756430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091e6ab-a889-480b-a9fa-d683616bd3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:58.758601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091e6ab-a889-480b-a9fa-d683616bd3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:58.761313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091e6ab-a889-480b-a9fa-d683616bd3fc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:58.793094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 876/1750] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:17:58.795525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776c0c-234f-4044-842e-0c124d491b83 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:17:58.806638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:58.814727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776c0c-234f-4044-842e-0c124d491b83 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:17:58.860661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c86df-3c43-49b6-aa9a-a89c230179a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:17:58.861380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c86df-3c43-49b6-aa9a-a89c230179a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.866459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c86df-3c43-49b6-aa9a-a89c230179a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.866459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c86df-3c43-49b6-aa9a-a89c230179a4 admin admin] PATH_INFO: `/v3/projects/7e683c4a2b704c38917ea2678e37e90b/users/1249649cbc3544988a03e159b0ce9d5f/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:58.876494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c86df-3c43-49b6-aa9a-a89c230179a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e683c4a2b704c38917ea2678e37e90b, user_id=1249649cbc3544988a03e159b0ce9d5f, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:17:58.887686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c86df-3c43-49b6-aa9a-a89c230179a4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:17:58.936495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 875/1751] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:17:58 2022] PUT /identity/v3/projects/7e683c4a2b704c38917ea2678e37e90b/users/1249649cbc3544988a03e159b0ce9d5f/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:17:58.940393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf559f3-ebee-4c6f-8f7a-5f8de324c9b3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:17:58.949394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf559f3-ebee-4c6f-8f7a-5f8de324c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:17:58.949394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf559f3-ebee-4c6f-8f7a-5f8de324c9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:17:59.041229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-5bf559f3-ebee-4c6f-8f7a-5f8de324c9b3 None None] MFA Rules not processed for user `1249649cbc3544988a03e159b0ce9d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:17:59.043323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5bf559f3-ebee-4c6f-8f7a-5f8de324c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:17:59.273652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 877/1752] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:17:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:17:59.964972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c86df-3c43-49b6-aa9a-a89c230179a4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:00.041266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c86df-3c43-49b6-aa9a-a89c230179a4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:00.047603 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a69a19-481f-46e8-882f-5d49638b2997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:00.048784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69a19-481f-46e8-882f-5d49638b2997 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:00.050304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69a19-481f-46e8-882f-5d49638b2997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:00.050304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69a19-481f-46e8-882f-5d49638b2997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:00.060844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a69a19-481f-46e8-882f-5d49638b2997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:00.062812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a69a19-481f-46e8-882f-5d49638b2997 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:00.087136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 876/1753] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:17:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:00.261420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45f27-a192-4da2-b98c-c7e4471fc811 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:00.261878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45f27-a192-4da2-b98c-c7e4471fc811 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:00.261953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45f27-a192-4da2-b98c-c7e4471fc811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:00.309257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bae45f27-a192-4da2-b98c-c7e4471fc811 None None] MFA Rules not processed for user `c7f5fe359aca4be3a2e609465298d637`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:00.310618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bae45f27-a192-4da2-b98c-c7e4471fc811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:00.496930 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 878/1754] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:00.675323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:00.829403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:01.465096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7076-178e-45c6-a0fa-d380b1f4e279 None None] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:01.465967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7076-178e-45c6-a0fa-d380b1f4e279 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:01.466261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f7076-178e-45c6-a0fa-d380b1f4e279 None None] PATH_INFO: `/` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:01.468040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 877/1755] 10.222.0.82 () {54 vars in 912 bytes} [Mon Aug 29 19:18:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:01.476206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2dbb-7b40-48b7-9cae-604022831609 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:01.480362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2dbb-7b40-48b7-9cae-604022831609 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:01.480964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9a2dbb-7b40-48b7-9cae-604022831609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-7c9a2dbb-7b40-48b7-9cae-604022831609 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:18:01.502894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:01.503915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:18:01.511575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 879/1756] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:18:01 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:18:02.483437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f7076-178e-45c6-a0fa-d380b1f4e279 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:02.649072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f7076-178e-45c6-a0fa-d380b1f4e279 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:02.662518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:02.664857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:02.666095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:02.670886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] PATH_INFO: `/v3/users/3a901052284c4bb68bfbf2077f58c9c3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:02.673272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a901052284c4bb68bfbf2077f58c9c3)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:02.679045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:03.087558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a901052284c4bb68bfbf2077f58c9c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:03.088477 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a901052284c4bb68bfbf2077f58c9c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:03.187317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9179c-3367-4d37-b348-aa99fb28b0d4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:03.188270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9179c-3367-4d37-b348-aa99fb28b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:03.188743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9179c-3367-4d37-b348-aa99fb28b0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:03.216400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a901052284c4bb68bfbf2077f58c9c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:03.218139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a901052284c4bb68bfbf2077f58c9c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:03.223623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-25f9179c-3367-4d37-b348-aa99fb28b0d4 None None] MFA Rules not processed for user `831190b97d2c4f36bfbaaf444ff20ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:03.226975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25f9179c-3367-4d37-b348-aa99fb28b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:03.253541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-36929a75-b12f-49e7-ae25-eaa28ac14753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a901052284c4bb68bfbf2077f58c9c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:03.286552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 878/1757] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:02 2022] DELETE /identity/v3/users/3a901052284c4bb68bfbf2077f58c9c3 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:03.287954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529d07-8f43-40f5-bcbf-7057d8acc9e0 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:03.288250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529d07-8f43-40f5-bcbf-7057d8acc9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:03.290050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d529d07-8f43-40f5-bcbf-7057d8acc9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:03.344035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2d529d07-8f43-40f5-bcbf-7057d8acc9e0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:03.345096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2d529d07-8f43-40f5-bcbf-7057d8acc9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:03.395416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 880/1758] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:03.556236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:03.583688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 879/1759] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:03.592401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9179c-3367-4d37-b348-aa99fb28b0d4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:03.596210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-25f9179c-3367-4d37-b348-aa99fb28b0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:03.689728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9179c-3367-4d37-b348-aa99fb28b0d4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:03.788766 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:03.789417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:03.789668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:03.790029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:03.803505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:03.805385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:03.835035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 881/1760] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:04.526168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1507c3-dde8-4507-b562-50f8871b17f8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:04.526758 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1507c3-dde8-4507-b562-50f8871b17f8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:04.527204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1507c3-dde8-4507-b562-50f8871b17f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3e1507c3-dde8-4507-b562-50f8871b17f8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:18:04.534969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:04.535880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:18:04.536703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:04.538262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:04.539180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 880/1761] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:18:04 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:18:04.595508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878f59b-d45d-462d-9a75-428b5a0e3a92 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:04.610902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:04.611586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:04.611918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:04.612200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] PATH_INFO: `/v3/projects/bbf15070c76a46ddb9e4730222f5d1e6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:04.614110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf15070c76a46ddb9e4730222f5d1e6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:04.616108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:04.823713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf15070c76a46ddb9e4730222f5d1e6', 'request_id': 'req-29b190d2-3354-41e6-8e6f-0e20350a162f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:04.929101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf15070c76a46ddb9e4730222f5d1e6', 'request_id': 'req-29b190d2-3354-41e6-8e6f-0e20350a162f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:04.937800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf15070c76a46ddb9e4730222f5d1e6', 'request_id': 'req-29b190d2-3354-41e6-8e6f-0e20350a162f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:04.952060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:04.964140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] The token cache is being invalidate because project bbf15070c76a46ddb9e4730222f5d1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:04.965091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:04.965875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-29b190d2-3354-41e6-8e6f-0e20350a162f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:04.967546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 882/1762] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:04 2022] DELETE /identity/v3/projects/bbf15070c76a46ddb9e4730222f5d1e6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:04.971690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1507c3-dde8-4507-b562-50f8871b17f8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:04.974190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3e1507c3-dde8-4507-b562-50f8871b17f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:05.166024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1507c3-dde8-4507-b562-50f8871b17f8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:05.172275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:05.197873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:05.197873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:05.197873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] PATH_INFO: `/v3/users/1249649cbc3544988a03e159b0ce9d5f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:05.209137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1249649cbc3544988a03e159b0ce9d5f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:05.211142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:05.226401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd531f7-aa3b-40d4-b4e5-f6c2056ed9f9 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:05.228792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd531f7-aa3b-40d4-b4e5-f6c2056ed9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:05.229242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd531f7-aa3b-40d4-b4e5-f6c2056ed9f9 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:05.231080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 883/1763] 10.222.0.82 () {54 vars in 921 bytes} [Mon Aug 29 19:18:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:05.277384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7c1e-bbcd-4825-b4e4-40b97d3c5eb5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:05.283442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7c1e-bbcd-4825-b4e4-40b97d3c5eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:05.283442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd7c1e-bbcd-4825-b4e4-40b97d3c5eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:05.320940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-eebd7c1e-bbcd-4825-b4e4-40b97d3c5eb5 None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:05.320940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eebd7c1e-bbcd-4825-b4e4-40b97d3c5eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:05.568974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 884/1764] 10.222.0.82 () {58 vars in 1018 bytes} [Mon Aug 29 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:05.570766 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd7c1e-bbcd-4825-b4e4-40b97d3c5eb5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:05.576789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eebd7c1e-bbcd-4825-b4e4-40b97d3c5eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:05.600194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1249649cbc3544988a03e159b0ce9d5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:05.602421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1249649cbc3544988a03e159b0ce9d5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:05.618736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd7c1e-bbcd-4825-b4e4-40b97d3c5eb5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:05.624583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:05.628586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:05.629459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:05.629968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] PATH_INFO: `/v3/users/303d742b77ed4eb798b7f28117b89c75` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:05.637490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=303d742b77ed4eb798b7f28117b89c75)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:05.644129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:05.765264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1249649cbc3544988a03e159b0ce9d5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:05.765918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1249649cbc3544988a03e159b0ce9d5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:05.786675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1249649cbc3544988a03e159b0ce9d5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:05.812871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 881/1765] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:04 2022] DELETE /identity/v3/users/1249649cbc3544988a03e159b0ce9d5f => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:05.813950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:05.818446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:05.954235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca5191-26a6-428f-93ee-a1416d9979e1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:05.962559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf58a62bd2e4139965fc25a4f9c6161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:05.963952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:05.964543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:05.965053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:05.970532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:05.987434 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303d742b77ed4eb798b7f28117b89c75'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:05.999254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:06.007777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:06.029340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 882/1766] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:06.099553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:06.148020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303d742b77ed4eb798b7f28117b89c75'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:06.148854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303d742b77ed4eb798b7f28117b89c75'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:06.177615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303d742b77ed4eb798b7f28117b89c75'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:06.178695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303d742b77ed4eb798b7f28117b89c75'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:06.206934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 885/1767] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:05 2022] DELETE /identity/v3/users/303d742b77ed4eb798b7f28117b89c75 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:06.286758 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:06.688075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:06.689102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:06.690958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:06.692003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:06.846045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b3c6b-d9b9-4986-b274-0d401661f90f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:06.847138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc3a0b-1bc3-4386-b610-280aa9f24245 service placement] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:06.852803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:06.853280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:06.853991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:06.854633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] PATH_INFO: `/v3/projects/7e683c4a2b704c38917ea2678e37e90b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:06.855999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:06.857029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:06.857380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e683c4a2b704c38917ea2678e37e90b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:06.857692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:06.858145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] PATH_INFO: `/v3/projects/20ff3cf1cbf14f5690951226556e46fa` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:06.859611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ff3cf1cbf14f5690951226556e46fa)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:06.860442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:06.861934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:07.037946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e683c4a2b704c38917ea2678e37e90b', 'request_id': 'req-ddb13374-7f6d-465a-92be-a57453a24002'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.137402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ff3cf1cbf14f5690951226556e46fa', 'request_id': 'req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.181248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e683c4a2b704c38917ea2678e37e90b', 'request_id': 'req-ddb13374-7f6d-465a-92be-a57453a24002'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.202736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e683c4a2b704c38917ea2678e37e90b', 'request_id': 'req-ddb13374-7f6d-465a-92be-a57453a24002'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.232005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] The token cache is being invalidate because project 7e683c4a2b704c38917ea2678e37e90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:07.232335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.233870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ddb13374-7f6d-465a-92be-a57453a24002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.237051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 886/1768] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:06 2022] DELETE /identity/v3/projects/7e683c4a2b704c38917ea2678e37e90b => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:07.242667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5107cb-ccc4-4264-b09b-ba8e1e78d145 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.242964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5107cb-ccc4-4264-b09b-ba8e1e78d145 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.243244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5107cb-ccc4-4264-b09b-ba8e1e78d145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.281078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ff3cf1cbf14f5690951226556e46fa', 'request_id': 'req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.288439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-be5107cb-ccc4-4264-b09b-ba8e1e78d145 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:07.289781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-be5107cb-ccc4-4264-b09b-ba8e1e78d145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:07.292592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ff3cf1cbf14f5690951226556e46fa', 'request_id': 'req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.328653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] The token cache is being invalidate because project 20ff3cf1cbf14f5690951226556e46fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:07.330007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.332783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3393bcd-30f7-4aba-a5df-5bb1bf14640a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:07.336553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:07.337553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 883/1769] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:06 2022] DELETE /identity/v3/projects/20ff3cf1cbf14f5690951226556e46fa => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:07.347014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4ef4-aee0-42c6-9501-8c6f6b73a41d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.348254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4ef4-aee0-42c6-9501-8c6f6b73a41d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.348831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4ef4-aee0-42c6-9501-8c6f6b73a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.425978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-485c4ef4-aee0-42c6-9501-8c6f6b73a41d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:07.429183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-485c4ef4-aee0-42c6-9501-8c6f6b73a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:07.465548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 887/1770] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:07.469769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df765-1004-4c8e-a14c-4d62e91f3080 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.471218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df765-1004-4c8e-a14c-4d62e91f3080 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.473268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9df765-1004-4c8e-a14c-4d62e91f3080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.523907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ae9df765-1004-4c8e-a14c-4d62e91f3080 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:07.527149 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ae9df765-1004-4c8e-a14c-4d62e91f3080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:07.549289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 888/1771] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:07.559227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df765-1004-4c8e-a14c-4d62e91f3080 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:07.575145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9df765-1004-4c8e-a14c-4d62e91f3080 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:07.582389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:07.583302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.584473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.584904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.585731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:07.586177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:07.588314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:07.596755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 884/1772] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:07.604877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 889/1773] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:07.613729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2313f-0012-4959-8075-7522741bb6da None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.613991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:07.614147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2313f-0012-4959-8075-7522741bb6da None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.614147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2313f-0012-4959-8075-7522741bb6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.623104 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849585e-e588-4ee8-8b12-13a5fc92e4ad admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:07.631273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e99a8a-e2a4-4b46-8573-26892a71e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:07.632137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e99a8a-e2a4-4b46-8573-26892a71e601 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.632515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e99a8a-e2a4-4b46-8573-26892a71e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.632903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e99a8a-e2a4-4b46-8573-26892a71e601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.633676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e99a8a-e2a4-4b46-8573-26892a71e601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:07.636292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e99a8a-e2a4-4b46-8573-26892a71e601 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:07.640202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-85f2313f-0012-4959-8075-7522741bb6da None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:07.642524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-85f2313f-0012-4959-8075-7522741bb6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:07.656103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 885/1774] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:07.660682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2313f-0012-4959-8075-7522741bb6da None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:07.712010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2313f-0012-4959-8075-7522741bb6da None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:07.723288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:07.723881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.724165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.724450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.725726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:07.726623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:07.728611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:07.747987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 886/1775] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:18:07.752389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:07.752822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 890/1776] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:07 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:07.753785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e99a8a-e2a4-4b46-8573-26892a71e601 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:07.764809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbffce-350e-43bb-8784-2d7b6f093590 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:07.830012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e99a8a-e2a4-4b46-8573-26892a71e601 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:07.837784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6614995-6a6c-4810-9a49-b13448b723a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:07.838446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614995-6a6c-4810-9a49-b13448b723a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.838729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614995-6a6c-4810-9a49-b13448b723a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.839236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6614995-6a6c-4810-9a49-b13448b723a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.840155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6614995-6a6c-4810-9a49-b13448b723a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:07.842370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6614995-6a6c-4810-9a49-b13448b723a4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:07.850492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1d2a0-99f0-4a4b-b9b2-845ef61a9fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:07.852618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d2a0-99f0-4a4b-b9b2-845ef61a9fa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:07.855170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d2a0-99f0-4a4b-b9b2-845ef61a9fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:07.855656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1d2a0-99f0-4a4b-b9b2-845ef61a9fa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:07.856502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1d2a0-99f0-4a4b-b9b2-845ef61a9fa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:07.858903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1d2a0-99f0-4a4b-b9b2-845ef61a9fa7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.070517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 891/1777] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:07 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:08.071932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 887/1778] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:07 2022] POST /identity/v3/projects => generated 375 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:08.075953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1d2a0-99f0-4a4b-b9b2-845ef61a9fa7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.076128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6614995-6a6c-4810-9a49-b13448b723a4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.087257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6614995-6a6c-4810-9a49-b13448b723a4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.153469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1d2a0-99f0-4a4b-b9b2-845ef61a9fa7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.161447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256af05-7854-4d85-8126-ddc352b2ead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.162634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256af05-7854-4d85-8126-ddc352b2ead9 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.162634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256af05-7854-4d85-8126-ddc352b2ead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.164093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256af05-7854-4d85-8126-ddc352b2ead9 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.166379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256af05-7854-4d85-8126-ddc352b2ead9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.169694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256af05-7854-4d85-8126-ddc352b2ead9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.171401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8004-92cc-4069-8730-7551688f112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.172270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8004-92cc-4069-8730-7551688f112b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.172737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8004-92cc-4069-8730-7551688f112b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.173195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8004-92cc-4069-8730-7551688f112b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.174070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea8004-92cc-4069-8730-7551688f112b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.182064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea8004-92cc-4069-8730-7551688f112b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.197044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 892/1779] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:08.201053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8004-92cc-4069-8730-7551688f112b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.212798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8004-92cc-4069-8730-7551688f112b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.218634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.219256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.219541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.220328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.220996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.222844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.248151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 893/1780] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:08.249550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.253094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:08.273981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389d3e-9240-4dfe-8f54-3f4c903d4f4c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.277482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 888/1781] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:08 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:08.278973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256af05-7854-4d85-8126-ddc352b2ead9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.279663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.280445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.280883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.281233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] PATH_INFO: `/v3/users/f534257027f34264bedd3d148ed37fe8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.283851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f534257027f34264bedd3d148ed37fe8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.286619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.295405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256af05-7854-4d85-8126-ddc352b2ead9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.301112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9abcb-a39f-413f-abf6-e58d3e9bea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.301902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9abcb-a39f-413f-abf6-e58d3e9bea17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.302703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9abcb-a39f-413f-abf6-e58d3e9bea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.302703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9abcb-a39f-413f-abf6-e58d3e9bea17 admin admin] PATH_INFO: `/v3/projects/7421b868a07248128527486fd639591d/users/df2c571b8c6246f2a0466fd94b1d3104/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.323839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9abcb-a39f-413f-abf6-e58d3e9bea17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7421b868a07248128527486fd639591d, user_id=df2c571b8c6246f2a0466fd94b1d3104, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.326292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9abcb-a39f-413f-abf6-e58d3e9bea17 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.450790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 889/1782] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:08 2022] PUT /identity/v3/projects/7421b868a07248128527486fd639591d/users/df2c571b8c6246f2a0466fd94b1d3104/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:08.450790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9abcb-a39f-413f-abf6-e58d3e9bea17 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.521144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9abcb-a39f-413f-abf6-e58d3e9bea17 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.525876 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16301-7014-47f7-8ce1-c45b4d2dce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.526475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16301-7014-47f7-8ce1-c45b4d2dce8f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.526761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16301-7014-47f7-8ce1-c45b4d2dce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.527038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16301-7014-47f7-8ce1-c45b4d2dce8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.527686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b16301-7014-47f7-8ce1-c45b4d2dce8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.529297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b16301-7014-47f7-8ce1-c45b4d2dce8f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.540619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 890/1783] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:08.540619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd90180-0d68-49c6-ac7f-f243e179e696 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.540619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd90180-0d68-49c6-ac7f-f243e179e696 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.540619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd90180-0d68-49c6-ac7f-f243e179e696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.547572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f534257027f34264bedd3d148ed37fe8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:08.574902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-dcd90180-0d68-49c6-ac7f-f243e179e696 None None] MFA Rules not processed for user `df2c571b8c6246f2a0466fd94b1d3104`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:08.574902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-dcd90180-0d68-49c6-ac7f-f243e179e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:08.591013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:08.645452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f534257027f34264bedd3d148ed37fe8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:08.646493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f534257027f34264bedd3d148ed37fe8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:08.685278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f534257027f34264bedd3d148ed37fe8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:08.686222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f534257027f34264bedd3d148ed37fe8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:08.698398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 891/1784] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:08.699405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd90180-0d68-49c6-ac7f-f243e179e696 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.708982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 894/1785] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:08 2022] DELETE /identity/v3/users/f534257027f34264bedd3d148ed37fe8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:08.710177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.712640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:08.735151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd90180-0d68-49c6-ac7f-f243e179e696 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.814468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d246-dfbc-44ba-ad33-222beb84e9b0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.822654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.822857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081eb09-348c-4e91-9513-5c574212af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.823905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081eb09-348c-4e91-9513-5c574212af34 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.824186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081eb09-348c-4e91-9513-5c574212af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.824393 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.824637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081eb09-348c-4e91-9513-5c574212af34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.824736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.825211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.825626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.825730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081eb09-348c-4e91-9513-5c574212af34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.827622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.827950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081eb09-348c-4e91-9513-5c574212af34 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.846121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 892/1786] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:08.861972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:08.873043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:08.896926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f78413-869b-41ed-90e9-1cfe8f01834a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:08.903820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1204e7-8f40-4b3a-816a-026c751a4fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:08.905042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1204e7-8f40-4b3a-816a-026c751a4fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:08.905576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1204e7-8f40-4b3a-816a-026c751a4fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:08.906047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1204e7-8f40-4b3a-816a-026c751a4fe4 admin admin] PATH_INFO: `/v3/projects/a2bdbc81a49e4a2b820e8327dd2befef/users/fad9be0620b84e4eb96839487e8b038c/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:08.924974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1204e7-8f40-4b3a-816a-026c751a4fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2bdbc81a49e4a2b820e8327dd2befef, user_id=fad9be0620b84e4eb96839487e8b038c, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:08.928654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1204e7-8f40-4b3a-816a-026c751a4fe4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:08.939073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 895/1787] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:08 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:08.953030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081eb09-348c-4e91-9513-5c574212af34 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:09.049850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 893/1788] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:08 2022] PUT /identity/v3/projects/a2bdbc81a49e4a2b820e8327dd2befef/users/fad9be0620b84e4eb96839487e8b038c/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:09.061284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0849-32b0-4845-90ab-a7e8da5fd63c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.061577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0849-32b0-4845-90ab-a7e8da5fd63c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.061864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f0849-32b0-4845-90ab-a7e8da5fd63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.068889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081eb09-348c-4e91-9513-5c574212af34 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:09.103848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4d7f0849-32b0-4845-90ab-a7e8da5fd63c None None] MFA Rules not processed for user `fad9be0620b84e4eb96839487e8b038c`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:09.105283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4d7f0849-32b0-4845-90ab-a7e8da5fd63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:09.232617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:09.233655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.234243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.235323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.236592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:09.242340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:09.284282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 894/1789] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:09.286893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0849-32b0-4845-90ab-a7e8da5fd63c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:09.290203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4d7f0849-32b0-4845-90ab-a7e8da5fd63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:09.335972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f0849-32b0-4845-90ab-a7e8da5fd63c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:09.344961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:09.346006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.347917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.347917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] PATH_INFO: `/v3/projects/92f8c1d4dd3c41b99bd8df6b328fc1c0` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.350934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f8c1d4dd3c41b99bd8df6b328fc1c0)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:09.354458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:09.406612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 896/1790] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:08 2022] POST /identity/v3/users => generated 294 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:09.407329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:09.409652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:09.438631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:09.517394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00c7b8-9085-4486-bbe2-e59b8cd00c5f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:09.524186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737daadb-c353-485f-82a0-d2fbb9cbc40b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:09.524844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737daadb-c353-485f-82a0-d2fbb9cbc40b service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.525140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737daadb-c353-485f-82a0-d2fbb9cbc40b service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.525412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737daadb-c353-485f-82a0-d2fbb9cbc40b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.535064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737daadb-c353-485f-82a0-d2fbb9cbc40b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:09.537419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737daadb-c353-485f-82a0-d2fbb9cbc40b service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:09.548719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 897/1791] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:09.549585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737daadb-c353-485f-82a0-d2fbb9cbc40b service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:09.562158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737daadb-c353-485f-82a0-d2fbb9cbc40b service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:09.562378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f8c1d4dd3c41b99bd8df6b328fc1c0', 'request_id': 'req-551174f5-435b-4e7d-9181-82d90363be0a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:09.648556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4def08-41c0-4fee-9681-208f8d7d0e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:09.649571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4def08-41c0-4fee-9681-208f8d7d0e4f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.650124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4def08-41c0-4fee-9681-208f8d7d0e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.650453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4def08-41c0-4fee-9681-208f8d7d0e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.651946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4def08-41c0-4fee-9681-208f8d7d0e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:09.652833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f8c1d4dd3c41b99bd8df6b328fc1c0', 'request_id': 'req-551174f5-435b-4e7d-9181-82d90363be0a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:09.655348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4def08-41c0-4fee-9681-208f8d7d0e4f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:09.668026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f8c1d4dd3c41b99bd8df6b328fc1c0', 'request_id': 'req-551174f5-435b-4e7d-9181-82d90363be0a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:09.676022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 898/1792] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:09.686590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4def08-41c0-4fee-9681-208f8d7d0e4f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:09.696369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] The token cache is being invalidate because project 92f8c1d4dd3c41b99bd8df6b328fc1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:09.698101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:09.700692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-551174f5-435b-4e7d-9181-82d90363be0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:09.706421 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4def08-41c0-4fee-9681-208f8d7d0e4f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:09.709470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 895/1793] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:09 2022] DELETE /identity/v3/projects/92f8c1d4dd3c41b99bd8df6b328fc1c0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:09.716536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9420186-9249-49c8-aea9-81effb11b16f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.717132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9420186-9249-49c8-aea9-81effb11b16f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.717718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9420186-9249-49c8-aea9-81effb11b16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.720778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:09.721224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.721688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.721891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.723585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:09.725343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:09.743715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 899/1794] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:09.745448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:09.747418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:09.754944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e9420186-9249-49c8-aea9-81effb11b16f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:09.756519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e9420186-9249-49c8-aea9-81effb11b16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:09.764849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc1246-2e97-4e67-892b-b49629dd6dba admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:09.768349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 896/1795] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:09.770760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2115-e6db-41b1-8c90-295b555be3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:09.772041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2115-e6db-41b1-8c90-295b555be3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.772491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2115-e6db-41b1-8c90-295b555be3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.772918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2115-e6db-41b1-8c90-295b555be3f2 admin admin] PATH_INFO: `/v3/projects/f9b45f9e9a8443d8b0b9919faeda01bc/users/f2018817e56a4cf396caf1cffd880684/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.776394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ca96d-e4d7-4577-ac6d-3cf3c36c2cbe None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.776888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ca96d-e4d7-4577-ac6d-3cf3c36c2cbe None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.777504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ca96d-e4d7-4577-ac6d-3cf3c36c2cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.793278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad2115-e6db-41b1-8c90-295b555be3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b45f9e9a8443d8b0b9919faeda01bc, user_id=f2018817e56a4cf396caf1cffd880684, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:09.796387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad2115-e6db-41b1-8c90-295b555be3f2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:09.813792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-615ca96d-e4d7-4577-ac6d-3cf3c36c2cbe None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:09.815604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-615ca96d-e4d7-4577-ac6d-3cf3c36c2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:09.827068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 897/1796] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:09.828629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801273-c464-4969-9b30-65b11d8c2332 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.830115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801273-c464-4969-9b30-65b11d8c2332 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.830115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de801273-c464-4969-9b30-65b11d8c2332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.852704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-de801273-c464-4969-9b30-65b11d8c2332 None None] MFA Rules not processed for user `c7f5fe359aca4be3a2e609465298d637`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:09.853976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de801273-c464-4969-9b30-65b11d8c2332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:09.871132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 900/1797] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:09 2022] PUT /identity/v3/projects/f9b45f9e9a8443d8b0b9919faeda01bc/users/f2018817e56a4cf396caf1cffd880684/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:09.872033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2115-e6db-41b1-8c90-295b555be3f2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:09.940469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 898/1798] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:09.942440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de801273-c464-4969-9b30-65b11d8c2332 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:09.944312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de801273-c464-4969-9b30-65b11d8c2332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:09.971212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de801273-c464-4969-9b30-65b11d8c2332 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:09.987169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2115-e6db-41b1-8c90-295b555be3f2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:09.995664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e25946-90d2-4409-8abe-0f4539fda8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:09.996727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e25946-90d2-4409-8abe-0f4539fda8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:09.998032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e25946-90d2-4409-8abe-0f4539fda8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:09.998562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e25946-90d2-4409-8abe-0f4539fda8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:09.999362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e25946-90d2-4409-8abe-0f4539fda8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:09.999829 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e25946-90d2-4409-8abe-0f4539fda8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:10.001812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e25946-90d2-4409-8abe-0f4539fda8d7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:10.016401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 901/1799] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:10.018368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168854a0-2ee9-4b81-af9b-a4a7f3f82542 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.018793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168854a0-2ee9-4b81-af9b-a4a7f3f82542 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.019378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168854a0-2ee9-4b81-af9b-a4a7f3f82542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.064505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-168854a0-2ee9-4b81-af9b-a4a7f3f82542 None None] MFA Rules not processed for user `f2018817e56a4cf396caf1cffd880684`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:10.066143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-168854a0-2ee9-4b81-af9b-a4a7f3f82542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:10.087037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:10.087806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.088159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.089527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] PATH_INFO: `/v3/users/fad9be0620b84e4eb96839487e8b038c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.091769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad9be0620b84e4eb96839487e8b038c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:10.094753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:10.181799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 902/1800] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:10.182701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168854a0-2ee9-4b81-af9b-a4a7f3f82542 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:10.195339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168854a0-2ee9-4b81-af9b-a4a7f3f82542 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:10.214774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:10.215411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.215692 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.216023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.216832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:10.218803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:10.254071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:10.345522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad9be0620b84e4eb96839487e8b038c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:10.346163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad9be0620b84e4eb96839487e8b038c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:10.356753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:10.369062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 903/1801] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:10.377742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:10.380216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:10.418533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad9be0620b84e4eb96839487e8b038c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:10.419200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad9be0620b84e4eb96839487e8b038c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:10.447062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad9be0620b84e4eb96839487e8b038c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:10.481719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 899/1802] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:09 2022] DELETE /identity/v3/users/fad9be0620b84e4eb96839487e8b038c => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:10.484827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:10.486399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:10.493676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49914c-7b22-46c9-a1fb-a91b7c68411d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:10.587850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa601bb-3aff-4320-9a23-183f6a9141c4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:10.590581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ce6e0-33ed-431c-8540-7b1fa4bfb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:10.591375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce6e0-33ed-431c-8540-7b1fa4bfb64e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.600451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce6e0-33ed-431c-8540-7b1fa4bfb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.601493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ce6e0-33ed-431c-8540-7b1fa4bfb64e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.602437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ce6e0-33ed-431c-8540-7b1fa4bfb64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:10.609954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ce6e0-33ed-431c-8540-7b1fa4bfb64e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:10.614031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe53d5a-b1bb-42c7-8e8e-3f2618d38755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:10.615528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe53d5a-b1bb-42c7-8e8e-3f2618d38755 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.616438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe53d5a-b1bb-42c7-8e8e-3f2618d38755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.616438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe53d5a-b1bb-42c7-8e8e-3f2618d38755 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.617194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe53d5a-b1bb-42c7-8e8e-3f2618d38755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:10.619608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe53d5a-b1bb-42c7-8e8e-3f2618d38755 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:10.734529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 900/1803] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:10.735743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 904/1804] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/projects => generated 387 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:10.735864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ffd0c-0d5a-4bc4-a81f-782cdb26332e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.736075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ffd0c-0d5a-4bc4-a81f-782cdb26332e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.736349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ffd0c-0d5a-4bc4-a81f-782cdb26332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.740929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc056f-405d-4896-ad90-4805f20ae8a5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.740929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc056f-405d-4896-ad90-4805f20ae8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-2e4ffd0c-0d5a-4bc4-a81f-782cdb26332e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:18:10.743717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:10.744639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:18:10.746266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 901/1805] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:18:10.746591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ffd0c-0d5a-4bc4-a81f-782cdb26332e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:10.754679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc056f-405d-4896-ad90-4805f20ae8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.789298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0efc056f-405d-4896-ad90-4805f20ae8a5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:10.790543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0efc056f-405d-4896-ad90-4805f20ae8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:10.833094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ffd0c-0d5a-4bc4-a81f-782cdb26332e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:10.847278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0da729-d2b1-445f-adc2-c339d7c25b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:10.848040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0da729-d2b1-445f-adc2-c339d7c25b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.849903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0da729-d2b1-445f-adc2-c339d7c25b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.850258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0da729-d2b1-445f-adc2-c339d7c25b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.858700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0da729-d2b1-445f-adc2-c339d7c25b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:10.858700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0da729-d2b1-445f-adc2-c339d7c25b85 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:10.866212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 902/1806] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:10.867620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0da729-d2b1-445f-adc2-c339d7c25b85 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:10.878287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0da729-d2b1-445f-adc2-c339d7c25b85 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:10.882874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 905/1807] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:10.884689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefca61-f673-4952-a67f-62d80734424b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.884981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefca61-f673-4952-a67f-62d80734424b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.885874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefca61-f673-4952-a67f-62d80734424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.893976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:10.895512 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:10.896241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:10.896241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:10.896767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:10.898945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:10.906648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bdefca61-f673-4952-a67f-62d80734424b None None] MFA Rules not processed for user `831190b97d2c4f36bfbaaf444ff20ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:10.907880 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bdefca61-f673-4952-a67f-62d80734424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:10.986776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 906/1808] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:10.988831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefca61-f673-4952-a67f-62d80734424b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.005787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefca61-f673-4952-a67f-62d80734424b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:11.012319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:11.013022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.013437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.013719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.014544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:11.016399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:11.034499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 903/1810] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:10 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:11.035807 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 907/1810] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:11.036709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.038070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.039894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:11.041815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:11.057167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf5937-23bf-489a-bb90-d2a64d08f08b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:11.062443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:11.063349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.064327 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.064327 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] PATH_INFO: `/v3/users/8fd7989e31db4c20808f565104c271a0` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.066142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd7989e31db4c20808f565104c271a0)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:11.068447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:11.110557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfe895-28cb-4448-bbf2-4355d9d648ce admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:11.115081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131a28-f6cf-438c-9962-86a728826c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:11.115271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131a28-f6cf-438c-9962-86a728826c4b service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.115700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131a28-f6cf-438c-9962-86a728826c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.116023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b131a28-f6cf-438c-9962-86a728826c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.126740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b131a28-f6cf-438c-9962-86a728826c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:11.128667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b131a28-f6cf-438c-9962-86a728826c4b service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:11.141914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 904/1811] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:11.142686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131a28-f6cf-438c-9962-86a728826c4b service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.157111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b131a28-f6cf-438c-9962-86a728826c4b service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:11.163339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcee0ba-0f69-4a3d-850e-c9d882d42ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:11.164012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee0ba-0f69-4a3d-850e-c9d882d42ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.164295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee0ba-0f69-4a3d-850e-c9d882d42ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.164971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcee0ba-0f69-4a3d-850e-c9d882d42ff6 admin admin] PATH_INFO: `/v3/projects/b7d661c66522410a905a4609ff156273/users/e1239200e38e499bb36153a0eb813c72/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.182604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcee0ba-0f69-4a3d-850e-c9d882d42ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d661c66522410a905a4609ff156273, user_id=e1239200e38e499bb36153a0eb813c72, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:11.185355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcee0ba-0f69-4a3d-850e-c9d882d42ff6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:11.310695 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 905/1812] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:11 2022] PUT /identity/v3/projects/b7d661c66522410a905a4609ff156273/users/e1239200e38e499bb36153a0eb813c72/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:11.312014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcee0ba-0f69-4a3d-850e-c9d882d42ff6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.384675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcee0ba-0f69-4a3d-850e-c9d882d42ff6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:11.389262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd7989e31db4c20808f565104c271a0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:11.394406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ddf3f-f99d-4996-a990-e4ea6953e1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:11.395367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ddf3f-f99d-4996-a990-e4ea6953e1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.395668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ddf3f-f99d-4996-a990-e4ea6953e1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.396058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ddf3f-f99d-4996-a990-e4ea6953e1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.402654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ddf3f-f99d-4996-a990-e4ea6953e1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:11.404344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8ddf3f-f99d-4996-a990-e4ea6953e1ce admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:11.420531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 906/1813] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:11.430568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aec88-77c5-471b-a773-4eadbb6e4b12 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.430568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aec88-77c5-471b-a773-4eadbb6e4b12 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.430568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56aec88-77c5-471b-a773-4eadbb6e4b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.456490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f56aec88-77c5-471b-a773-4eadbb6e4b12 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:11.458158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f56aec88-77c5-471b-a773-4eadbb6e4b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:11.483912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 907/1814] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:11.483912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56aec88-77c5-471b-a773-4eadbb6e4b12 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.486937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56aec88-77c5-471b-a773-4eadbb6e4b12 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:11.493179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:11.494082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.494496 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.494846 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] PATH_INFO: `/v3/projects/312f55300bbd47d6aa4bc900db4e5532/users/a082433cb6324acaba5e5b4f4e8b8e81/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.511532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd7989e31db4c20808f565104c271a0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:11.512250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd7989e31db4c20808f565104c271a0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:11.533752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312f55300bbd47d6aa4bc900db4e5532, user_id=a082433cb6324acaba5e5b4f4e8b8e81, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:11.533752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:11.537892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd7989e31db4c20808f565104c271a0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:11.538657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd7989e31db4c20808f565104c271a0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:11.558148 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 908/1815] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:11 2022] DELETE /identity/v3/users/8fd7989e31db4c20808f565104c271a0 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:11.563681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.565493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:11.744200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe82da5-76d8-47b9-aab8-d868f4e2b86c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:11.748157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca18256-f48f-4709-9e8f-06f4b05bba09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:11.748771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18256-f48f-4709-9e8f-06f4b05bba09 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.749055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18256-f48f-4709-9e8f-06f4b05bba09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.749330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca18256-f48f-4709-9e8f-06f4b05bba09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.751075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cca18256-f48f-4709-9e8f-06f4b05bba09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:11.815093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca18256-f48f-4709-9e8f-06f4b05bba09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:11.817079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca18256-f48f-4709-9e8f-06f4b05bba09 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:11.826804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 909/1816] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:11.828094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23c21c-d5c7-41aa-9cef-57f939192f8f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.828385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23c21c-d5c7-41aa-9cef-57f939192f8f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.828664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23c21c-d5c7-41aa-9cef-57f939192f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-1d23c21c-d5c7-41aa-9cef-57f939192f8f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:18:11.835207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:11.836029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:18:11.836908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 910/1817] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:18:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:18:11.837435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf633-7529-43bd-a9de-bb1c526847c8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:11.837716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf633-7529-43bd-a9de-bb1c526847c8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:11.838195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cf633-7529-43bd-a9de-bb1c526847c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:11.857392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:11.885150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 908/1818] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:11 2022] PUT /identity/v3/projects/312f55300bbd47d6aa4bc900db4e5532/users/a082433cb6324acaba5e5b4f4e8b8e81/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:11.887719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:11.895384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:11.896612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-366cf633-7529-43bd-a9de-bb1c526847c8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:11.899864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-366cf633-7529-43bd-a9de-bb1c526847c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:12.014318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 911/1819] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:12.015303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cf633-7529-43bd-a9de-bb1c526847c8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:12.016905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-366cf633-7529-43bd-a9de-bb1c526847c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:12.025671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:12.032336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cf633-7529-43bd-a9de-bb1c526847c8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:12.034862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8415210-ab33-4952-b27a-5c3556a5f120 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:12.042130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:12.042789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.043418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.043797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] PATH_INFO: `/v3/projects/a2bdbc81a49e4a2b820e8327dd2befef` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.044968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2bdbc81a49e4a2b820e8327dd2befef)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:12.047568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:12.059369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:12.060456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.071656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.071656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.071656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:12.071656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:12.080313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 912/1820] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:12.081509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:12.085260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:12.186032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34b0e8-2aa9-4f66-badb-fd9db51ee0cc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:12.187365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2bdbc81a49e4a2b820e8327dd2befef', 'request_id': 'req-7134a53b-d376-4aa3-a851-a3ff3e4266c0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:12.253075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67141ed-ad09-4442-9a1e-c1e65d02efc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:12.254666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67141ed-ad09-4442-9a1e-c1e65d02efc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.255147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67141ed-ad09-4442-9a1e-c1e65d02efc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.255547 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67141ed-ad09-4442-9a1e-c1e65d02efc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.304016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2bdbc81a49e4a2b820e8327dd2befef', 'request_id': 'req-7134a53b-d376-4aa3-a851-a3ff3e4266c0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:12.311495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2bdbc81a49e4a2b820e8327dd2befef', 'request_id': 'req-7134a53b-d376-4aa3-a851-a3ff3e4266c0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:12.332476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] The token cache is being invalidate because project a2bdbc81a49e4a2b820e8327dd2befef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:12.332886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:12.333676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67141ed-ad09-4442-9a1e-c1e65d02efc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:12.335199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67141ed-ad09-4442-9a1e-c1e65d02efc6 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:12.337809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:12.345222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 909/1821] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:11 2022] DELETE /identity/v3/projects/a2bdbc81a49e4a2b820e8327dd2befef => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:12.345222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:12.345222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:12.353577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 913/1822] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:12.358150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134a53b-d376-4aa3-a851-a3ff3e4266c0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:12.362183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c5dc8-c1fd-4742-ad61-c908eac41a66 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.363680 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c5dc8-c1fd-4742-ad61-c908eac41a66 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.366157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c5dc8-c1fd-4742-ad61-c908eac41a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.366494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c51d8-7fc8-4f06-a299-828ab10f80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:12.367295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c51d8-7fc8-4f06-a299-828ab10f80d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.367680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c51d8-7fc8-4f06-a299-828ab10f80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.368474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c51d8-7fc8-4f06-a299-828ab10f80d5 admin admin] PATH_INFO: `/v3/projects/312f55300bbd47d6aa4bc900db4e5532/users/a082433cb6324acaba5e5b4f4e8b8e81/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.370834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c51d8-7fc8-4f06-a299-828ab10f80d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312f55300bbd47d6aa4bc900db4e5532, user_id=a082433cb6324acaba5e5b4f4e8b8e81, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:12.375462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c51d8-7fc8-4f06-a299-828ab10f80d5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:12.390977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 910/1823] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:12 2022] PUT /identity/v3/projects/312f55300bbd47d6aa4bc900db4e5532/users/a082433cb6324acaba5e5b4f4e8b8e81/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:12.403122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4409c-9bce-4f50-bff7-a9a43ce4d39c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.403547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4409c-9bce-4f50-bff7-a9a43ce4d39c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.403991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4409c-9bce-4f50-bff7-a9a43ce4d39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.412728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-344c5dc8-c1fd-4742-ad61-c908eac41a66 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:12.415179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-344c5dc8-c1fd-4742-ad61-c908eac41a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:12.450018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e6d4409c-9bce-4f50-bff7-a9a43ce4d39c None None] MFA Rules not processed for user `a082433cb6324acaba5e5b4f4e8b8e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:12.451684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e6d4409c-9bce-4f50-bff7-a9a43ce4d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:12.488682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 914/1824] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:12.496712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eeee0-6ea0-4f3c-bca1-dcebd148b2b9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.503298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eeee0-6ea0-4f3c-bca1-dcebd148b2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.503298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eeee0-6ea0-4f3c-bca1-dcebd148b2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.517996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-347eeee0-6ea0-4f3c-bca1-dcebd148b2b9 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:12.519910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-347eeee0-6ea0-4f3c-bca1-dcebd148b2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:12.529040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 915/1825] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:12.532561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 911/1826] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:12.535042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eeee0-6ea0-4f3c-bca1-dcebd148b2b9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:12.548686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eeee0-6ea0-4f3c-bca1-dcebd148b2b9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:12.549062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4409c-9bce-4f50-bff7-a9a43ce4d39c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:12.551023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e6d4409c-9bce-4f50-bff7-a9a43ce4d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:12.556895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:12.557589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.559576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.559576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.560700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:12.561009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:12.569118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:12.588536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 916/1827] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:12.589606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:12.603704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee187-a541-4c01-ae7a-c6ab4ab71476 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:12.650254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f740c8-fadd-4c8d-97f3-ee29c3b84950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:12.651032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f740c8-fadd-4c8d-97f3-ee29c3b84950 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.651323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f740c8-fadd-4c8d-97f3-ee29c3b84950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.651792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f740c8-fadd-4c8d-97f3-ee29c3b84950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.652585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f740c8-fadd-4c8d-97f3-ee29c3b84950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:12.654576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f740c8-fadd-4c8d-97f3-ee29c3b84950 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:12.666282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4409c-9bce-4f50-bff7-a9a43ce4d39c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:12.671216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba568a-556d-4f18-902a-7647efc2e3b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:12.672784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba568a-556d-4f18-902a-7647efc2e3b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.673212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba568a-556d-4f18-902a-7647efc2e3b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.673633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba568a-556d-4f18-902a-7647efc2e3b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.708085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba568a-556d-4f18-902a-7647efc2e3b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:12.710301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba568a-556d-4f18-902a-7647efc2e3b6 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:12.725308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 912/1828] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:12.765606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 917/1829] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:12 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:12.770476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba568a-556d-4f18-902a-7647efc2e3b6 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:12.831068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba568a-556d-4f18-902a-7647efc2e3b6 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:12.966358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd99bbe-96d1-4fe1-a22f-ef6b29119d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:12.967241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99bbe-96d1-4fe1-a22f-ef6b29119d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:12.967697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99bbe-96d1-4fe1-a22f-ef6b29119d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:12.968135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd99bbe-96d1-4fe1-a22f-ef6b29119d89 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:12.968977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd99bbe-96d1-4fe1-a22f-ef6b29119d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:12.971071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd99bbe-96d1-4fe1-a22f-ef6b29119d89 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:13.063690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 913/1830] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:12 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:13.069058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f740c8-fadd-4c8d-97f3-ee29c3b84950 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:13.080895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f740c8-fadd-4c8d-97f3-ee29c3b84950 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:13.086841 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1416586-fd13-44d9-920b-431829f9d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:13.087376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1416586-fd13-44d9-920b-431829f9d936 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:13.087683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1416586-fd13-44d9-920b-431829f9d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:13.088035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1416586-fd13-44d9-920b-431829f9d936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:13.089089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1416586-fd13-44d9-920b-431829f9d936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:13.090454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1416586-fd13-44d9-920b-431829f9d936 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:13.109156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 918/1831] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:13.109986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd99bbe-96d1-4fe1-a22f-ef6b29119d89 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:13.121704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd99bbe-96d1-4fe1-a22f-ef6b29119d89 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:13.126985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:13.127595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:13.127993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:13.128278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:13.129429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:13.131308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:13.151606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 914/1832] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:13.157387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1416586-fd13-44d9-920b-431829f9d936 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:13.171624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1416586-fd13-44d9-920b-431829f9d936 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:13.184925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588293fe-b014-4bbe-9059-44708e10040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:13.185644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588293fe-b014-4bbe-9059-44708e10040c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:13.185929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588293fe-b014-4bbe-9059-44708e10040c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:13.186205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588293fe-b014-4bbe-9059-44708e10040c admin admin] PATH_INFO: `/v3/projects/c532d1f2cc9647d9a76deb9071f5f675/users/6387f1a2c416482aac59828068fda5bf/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:13.213514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588293fe-b014-4bbe-9059-44708e10040c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c532d1f2cc9647d9a76deb9071f5f675, user_id=6387f1a2c416482aac59828068fda5bf, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:13.218779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588293fe-b014-4bbe-9059-44708e10040c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:13.323765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:13.325858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:13.349474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 919/1833] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:13 2022] PUT /identity/v3/projects/c532d1f2cc9647d9a76deb9071f5f675/users/6387f1a2c416482aac59828068fda5bf/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:13.367443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d756d-36b1-4c7e-b195-da8dda882633 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:13.367443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d756d-36b1-4c7e-b195-da8dda882633 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:13.367443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d756d-36b1-4c7e-b195-da8dda882633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:13.368012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cfd3e-5804-4162-b5bc-cc4626e8a2d5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:13.446942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d25d756d-36b1-4c7e-b195-da8dda882633 None None] MFA Rules not processed for user `6387f1a2c416482aac59828068fda5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:13.448283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d25d756d-36b1-4c7e-b195-da8dda882633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:13.555110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:13.555962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:13.556326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:13.556611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] PATH_INFO: `/v3/projects/0f86e2480d6f49b087811ba4ed6ac842` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:13.558112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f86e2480d6f49b087811ba4ed6ac842)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:13.561385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:13.598375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 920/1834] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:13.599492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d756d-36b1-4c7e-b195-da8dda882633 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:13.614761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d756d-36b1-4c7e-b195-da8dda882633 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:13.620902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192401c-5ca9-4a17-9b35-9960ef284dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:13.621582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192401c-5ca9-4a17-9b35-9960ef284dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:13.621938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192401c-5ca9-4a17-9b35-9960ef284dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:13.630310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192401c-5ca9-4a17-9b35-9960ef284dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:13.630310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192401c-5ca9-4a17-9b35-9960ef284dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:13.630310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192401c-5ca9-4a17-9b35-9960ef284dfe admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:13.733573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 921/1835] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:13 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:13.737943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192401c-5ca9-4a17-9b35-9960ef284dfe admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:13.775183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f86e2480d6f49b087811ba4ed6ac842', 'request_id': 'req-5a41d100-8dfd-4d5b-a79c-8727893211cb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:13.822839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192401c-5ca9-4a17-9b35-9960ef284dfe admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:13.833192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:13.833951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:13.834634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:13.835110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:13.836480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:13.839446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:13.857709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f86e2480d6f49b087811ba4ed6ac842', 'request_id': 'req-5a41d100-8dfd-4d5b-a79c-8727893211cb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:13.886992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f86e2480d6f49b087811ba4ed6ac842', 'request_id': 'req-5a41d100-8dfd-4d5b-a79c-8727893211cb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:13.917851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] The token cache is being invalidate because project 0f86e2480d6f49b087811ba4ed6ac842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:13.918865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:13.920548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:13.923026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 915/1836] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:13 2022] DELETE /identity/v3/projects/0f86e2480d6f49b087811ba4ed6ac842 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:13.927920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:13.931128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:13.966918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 922/1837] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:13 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:13.968857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:13.979211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:14.028771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aea7d-e0dd-4fad-a896-3bc49ee5c18b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:14.043256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0801154-1e72-4aef-8d36-c292b6b5f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:14.044410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0801154-1e72-4aef-8d36-c292b6b5f908 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:14.044835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0801154-1e72-4aef-8d36-c292b6b5f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:14.045253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0801154-1e72-4aef-8d36-c292b6b5f908 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:14.046114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0801154-1e72-4aef-8d36-c292b6b5f908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:14.053816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0801154-1e72-4aef-8d36-c292b6b5f908 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:14.091879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 923/1838] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:14.110001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0801154-1e72-4aef-8d36-c292b6b5f908 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:14.133110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0801154-1e72-4aef-8d36-c292b6b5f908 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:14.139983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:14.152623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:14.155509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:14.156591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] PATH_INFO: `/v3/projects/4a60db30fb9343c381d5844fae87671a/users/de406a34d29b4388b4b67c63a91c4eb9/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:14.175904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41d100-8dfd-4d5b-a79c-8727893211cb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:14.204249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a60db30fb9343c381d5844fae87671a, user_id=de406a34d29b4388b4b67c63a91c4eb9, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:14.213274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:14.217299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:14.218183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:14.218467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:14.218742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] PATH_INFO: `/v3/users/cc7778bee09744a0ac3ae75cb28911b5` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:14.220353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7778bee09744a0ac3ae75cb28911b5)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:14.223062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:14.358140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 924/1839] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:14 2022] PUT /identity/v3/projects/4a60db30fb9343c381d5844fae87671a/users/de406a34d29b4388b4b67c63a91c4eb9/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:14.358140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:14.358140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:14.433729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e9163-a3a3-4ae4-8be0-f6e9ba689f02 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:14.438032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:14.438715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:14.439032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:14.439307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:14.442040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:14.520376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7778bee09744a0ac3ae75cb28911b5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:14.522467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7778bee09744a0ac3ae75cb28911b5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:14.536731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:14.538271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:14.550159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 925/1840] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:14.556690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:14.625615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7778bee09744a0ac3ae75cb28911b5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:14.626252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7778bee09744a0ac3ae75cb28911b5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:14.649020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7778bee09744a0ac3ae75cb28911b5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:14.676635 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 916/1841] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:13 2022] DELETE /identity/v3/users/cc7778bee09744a0ac3ae75cb28911b5 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:14.677995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7606c-dd09-4a02-b291-d3a2653bb40a service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:14.733610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:14.768467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283da7-e8b6-47f7-88e1-23933d085351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:14.769753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283da7-e8b6-47f7-88e1-23933d085351 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:14.773941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283da7-e8b6-47f7-88e1-23933d085351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:14.773941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283da7-e8b6-47f7-88e1-23933d085351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:14.773941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283da7-e8b6-47f7-88e1-23933d085351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:14.775151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283da7-e8b6-47f7-88e1-23933d085351 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:14.813006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 926/1842] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:14.817847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:14.820305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:14.846970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0f3a2-f0a3-4318-9844-d9e2c0af7258 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:14.855827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:14.863957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:14.864979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:14.865414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:14.865837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] PATH_INFO: `/v3/projects/4a60db30fb9343c381d5844fae87671a/users/de406a34d29b4388b4b67c63a91c4eb9/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:14.868982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a60db30fb9343c381d5844fae87671a, user_id=de406a34d29b4388b4b67c63a91c4eb9, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:14.876954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:14.923095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 917/1843] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:14 2022] PUT /identity/v3/projects/4a60db30fb9343c381d5844fae87671a/users/de406a34d29b4388b4b67c63a91c4eb9/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:14.938558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc9253-8cae-417a-937a-6f5f57c53347 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:14.939497 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc9253-8cae-417a-937a-6f5f57c53347 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:14.940463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc9253-8cae-417a-937a-6f5f57c53347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:15.028661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-eacc9253-8cae-417a-937a-6f5f57c53347 None None] MFA Rules not processed for user `de406a34d29b4388b4b67c63a91c4eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:15.035521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eacc9253-8cae-417a-937a-6f5f57c53347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:15.199460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 927/1844] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:15.242126 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:15.243795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:15.408619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3600b-6515-4f06-83f7-0953582a410e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:15.414618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafd300-8f2f-44f8-b53d-22c3e4929673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:15.416467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafd300-8f2f-44f8-b53d-22c3e4929673 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:15.416755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafd300-8f2f-44f8-b53d-22c3e4929673 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:15.418820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafd300-8f2f-44f8-b53d-22c3e4929673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:15.423250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4aafd300-8f2f-44f8-b53d-22c3e4929673 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:15.513461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafd300-8f2f-44f8-b53d-22c3e4929673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:15.515543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafd300-8f2f-44f8-b53d-22c3e4929673 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:15.527664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 918/1845] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:16.087196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc9253-8cae-417a-937a-6f5f57c53347 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:16.088713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eacc9253-8cae-417a-937a-6f5f57c53347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:16.255613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc9253-8cae-417a-937a-6f5f57c53347 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:16.270282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:16.270946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:16.271227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:16.273151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] PATH_INFO: `/v3/projects/7a2c298eefef4806b94eb63e9ed99963` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:16.273380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2c298eefef4806b94eb63e9ed99963)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:16.275676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:16.505074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2c298eefef4806b94eb63e9ed99963', 'request_id': 'req-d9e01b88-57f8-4446-92f8-4b195ff12f99'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:16.654594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2c298eefef4806b94eb63e9ed99963', 'request_id': 'req-d9e01b88-57f8-4446-92f8-4b195ff12f99'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:16.683141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2c298eefef4806b94eb63e9ed99963', 'request_id': 'req-d9e01b88-57f8-4446-92f8-4b195ff12f99'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:16.706681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] The token cache is being invalidate because project 7a2c298eefef4806b94eb63e9ed99963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:16.707459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:16.710590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d9e01b88-57f8-4446-92f8-4b195ff12f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:16.718643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 928/1846] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:16 2022] DELETE /identity/v3/projects/7a2c298eefef4806b94eb63e9ed99963 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:16.720284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9876125-1884-4396-bb7c-6918544f820f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:16.721017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9876125-1884-4396-bb7c-6918544f820f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:16.721300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9876125-1884-4396-bb7c-6918544f820f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:16.755043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f9876125-1884-4396-bb7c-6918544f820f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:16.756346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f9876125-1884-4396-bb7c-6918544f820f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:16.851957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 919/1847] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:16.860430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498937b-9d9d-4850-acd8-d10abeab1a29 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:16.860728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498937b-9d9d-4850-acd8-d10abeab1a29 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:16.861004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498937b-9d9d-4850-acd8-d10abeab1a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:16.909350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b498937b-9d9d-4850-acd8-d10abeab1a29 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:16.910561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b498937b-9d9d-4850-acd8-d10abeab1a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:16.942753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 929/1848] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:16.943678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9876125-1884-4396-bb7c-6918544f820f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:16.960206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9876125-1884-4396-bb7c-6918544f820f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:16.965469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:16.970668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:16.971624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:16.972702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:16.973325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:16.974357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:16.975086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:16.977468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:17.018578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 920/1849] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:17.019389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498937b-9d9d-4850-acd8-d10abeab1a29 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:17.031629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498937b-9d9d-4850-acd8-d10abeab1a29 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:17.041556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:17.043610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedcd26-099b-4192-a927-345b8c474dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:17.044397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedcd26-099b-4192-a927-345b8c474dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:17.044937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedcd26-099b-4192-a927-345b8c474dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:17.046432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedcd26-099b-4192-a927-345b8c474dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:17.049743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedcd26-099b-4192-a927-345b8c474dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:17.073705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedcd26-099b-4192-a927-345b8c474dbb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:17.286184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 930/1850] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:17 2022] POST /identity/v3/projects => generated 367 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:17.286940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:17.297307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3dc9f-e3fb-4ed8-952a-94034d8c43b5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:17.381627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b15f9-0ad0-4175-ba16-01bde0c44a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:17.381627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b15f9-0ad0-4175-ba16-01bde0c44a26 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:17.381627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b15f9-0ad0-4175-ba16-01bde0c44a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:17.381627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b15f9-0ad0-4175-ba16-01bde0c44a26 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:17.382100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b15f9-0ad0-4175-ba16-01bde0c44a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:17.382100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b15f9-0ad0-4175-ba16-01bde0c44a26 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:17.568334 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 921/1851] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:17 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:17.573340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedcd26-099b-4192-a927-345b8c474dbb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:17.606602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedcd26-099b-4192-a927-345b8c474dbb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:17.626743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33834f-e84e-4fa8-aa47-6cb7134b6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:17.627437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33834f-e84e-4fa8-aa47-6cb7134b6b2e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:17.628368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33834f-e84e-4fa8-aa47-6cb7134b6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:17.628653 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33834f-e84e-4fa8-aa47-6cb7134b6b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:17.630388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33834f-e84e-4fa8-aa47-6cb7134b6b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:17.634664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33834f-e84e-4fa8-aa47-6cb7134b6b2e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:17.665792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 931/1852] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:17.666471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b15f9-0ad0-4175-ba16-01bde0c44a26 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:17.686278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b15f9-0ad0-4175-ba16-01bde0c44a26 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:17.703462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e1e9a-44ce-4e39-88f6-30a33633f05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:17.704529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1e9a-44ce-4e39-88f6-30a33633f05a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:17.704961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1e9a-44ce-4e39-88f6-30a33633f05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:17.705962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e1e9a-44ce-4e39-88f6-30a33633f05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:17.707694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e1e9a-44ce-4e39-88f6-30a33633f05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:17.714868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e1e9a-44ce-4e39-88f6-30a33633f05a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:17.751185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33834f-e84e-4fa8-aa47-6cb7134b6b2e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:17.762251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 922/1853] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:17.768301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33834f-e84e-4fa8-aa47-6cb7134b6b2e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:17.785198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311a5b-5efe-4d11-8dea-4d3c987d4ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:17.786267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311a5b-5efe-4d11-8dea-4d3c987d4ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:17.786898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311a5b-5efe-4d11-8dea-4d3c987d4ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:17.787418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311a5b-5efe-4d11-8dea-4d3c987d4ac5 admin admin] PATH_INFO: `/v3/projects/fc414b6c365d4327bf78cc7a939633ac/users/6ced7205b5864273990c128820e1f795/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:17.835822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c311a5b-5efe-4d11-8dea-4d3c987d4ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc414b6c365d4327bf78cc7a939633ac, user_id=6ced7205b5864273990c128820e1f795, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:17.840951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c311a5b-5efe-4d11-8dea-4d3c987d4ac5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:17.950179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 932/1854] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:17 2022] PUT /identity/v3/projects/fc414b6c365d4327bf78cc7a939633ac/users/6ced7205b5864273990c128820e1f795/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:17.963681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aec1e-dfc2-4e6a-add2-3e67c1b2cdb5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:17.964026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aec1e-dfc2-4e6a-add2-3e67c1b2cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:17.964308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7aec1e-dfc2-4e6a-add2-3e67c1b2cdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:18.016940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5b7aec1e-dfc2-4e6a-add2-3e67c1b2cdb5 None None] MFA Rules not processed for user `6ced7205b5864273990c128820e1f795`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:18.018143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5b7aec1e-dfc2-4e6a-add2-3e67c1b2cdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:18.132871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 923/1855] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:18.138184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311a5b-5efe-4d11-8dea-4d3c987d4ac5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:18.256901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311a5b-5efe-4d11-8dea-4d3c987d4ac5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:18.262293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aebf2-1f8b-44da-a245-b22d410f847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:18.262936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aebf2-1f8b-44da-a245-b22d410f847c admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:18.263404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aebf2-1f8b-44da-a245-b22d410f847c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:18.264130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aebf2-1f8b-44da-a245-b22d410f847c admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:18.264897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386aebf2-1f8b-44da-a245-b22d410f847c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:18.266835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386aebf2-1f8b-44da-a245-b22d410f847c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:18.369673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 933/1856] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:18 2022] POST /identity/v3/projects => generated 369 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:18.373752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aec1e-dfc2-4e6a-add2-3e67c1b2cdb5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:18.388377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7aec1e-dfc2-4e6a-add2-3e67c1b2cdb5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:18.500989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450984cc-9446-4a0f-9e12-2c263161f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:18.502036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450984cc-9446-4a0f-9e12-2c263161f057 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:18.502322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450984cc-9446-4a0f-9e12-2c263161f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:18.502649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450984cc-9446-4a0f-9e12-2c263161f057 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:18.503974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450984cc-9446-4a0f-9e12-2c263161f057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:18.506233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450984cc-9446-4a0f-9e12-2c263161f057 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:18.679247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 924/1857] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:18 2022] POST /identity/v3/users => generated 291 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:18.683015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aebf2-1f8b-44da-a245-b22d410f847c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:18.698409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aebf2-1f8b-44da-a245-b22d410f847c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:18.704159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:18.705113 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:18.705609 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:18.706031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:18.706877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:18.709612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:18.757657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 934/1858] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:18.762818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450984cc-9446-4a0f-9e12-2c263161f057 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:18.776166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450984cc-9446-4a0f-9e12-2c263161f057 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:18.781382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105afd93-6533-4506-b5ba-180786f42d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:18.782059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105afd93-6533-4506-b5ba-180786f42d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:18.782336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105afd93-6533-4506-b5ba-180786f42d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:18.782815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105afd93-6533-4506-b5ba-180786f42d33 admin admin] PATH_INFO: `/v3/projects/9a507bc00c6345de8986ca2b2f40041c/users/4fef8128b33a4790ac58f3adf232c28d/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:18.809995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105afd93-6533-4506-b5ba-180786f42d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a507bc00c6345de8986ca2b2f40041c, user_id=4fef8128b33a4790ac58f3adf232c28d, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:18.813350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105afd93-6533-4506-b5ba-180786f42d33 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:18.953650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 925/1859] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:18 2022] PUT /identity/v3/projects/9a507bc00c6345de8986ca2b2f40041c/users/4fef8128b33a4790ac58f3adf232c28d/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:18.960561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:18.961931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105afd93-6533-4506-b5ba-180786f42d33 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:18.965225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:18.995419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb66d1-758d-4551-90c1-007368355ac5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:19.163465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105afd93-6533-4506-b5ba-180786f42d33 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:19.173566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14903fb-91f2-470c-b5ef-f7b2afa67a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:19.177891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14903fb-91f2-470c-b5ef-f7b2afa67a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:19.178184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14903fb-91f2-470c-b5ef-f7b2afa67a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:19.178466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14903fb-91f2-470c-b5ef-f7b2afa67a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:19.179152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14903fb-91f2-470c-b5ef-f7b2afa67a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:19.182155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:19.182975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:19.183169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:19.183608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] PATH_INFO: `/v3/users/c7f5fe359aca4be3a2e609465298d637` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:19.185905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f5fe359aca4be3a2e609465298d637)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:19.187891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:19.188158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14903fb-91f2-470c-b5ef-f7b2afa67a11 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:19.212067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 926/1860] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:19.229298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14903fb-91f2-470c-b5ef-f7b2afa67a11 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:19.262649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14903fb-91f2-470c-b5ef-f7b2afa67a11 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:19.279296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1763967-332b-464d-8686-58f7067213aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:19.280556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763967-332b-464d-8686-58f7067213aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:19.280856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763967-332b-464d-8686-58f7067213aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:19.282151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763967-332b-464d-8686-58f7067213aa admin admin] PATH_INFO: `/v3/projects/9a507bc00c6345de8986ca2b2f40041c/users/4fef8128b33a4790ac58f3adf232c28d/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:19.285983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763967-332b-464d-8686-58f7067213aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a507bc00c6345de8986ca2b2f40041c, user_id=4fef8128b33a4790ac58f3adf232c28d, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:19.293892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763967-332b-464d-8686-58f7067213aa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:19.320397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 927/1861] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:19 2022] PUT /identity/v3/projects/9a507bc00c6345de8986ca2b2f40041c/users/4fef8128b33a4790ac58f3adf232c28d/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:19.344854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab8d05-a568-48fa-b4b2-4fef2a8b5663 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:19.347481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab8d05-a568-48fa-b4b2-4fef2a8b5663 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:19.348143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab8d05-a568-48fa-b4b2-4fef2a8b5663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:19.424180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3cab8d05-a568-48fa-b4b2-4fef2a8b5663 None None] MFA Rules not processed for user `4fef8128b33a4790ac58f3adf232c28d`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:19.429435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3cab8d05-a568-48fa-b4b2-4fef2a8b5663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:19.484544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f5fe359aca4be3a2e609465298d637'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:19.594842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 928/1862] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:19.612309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f5fe359aca4be3a2e609465298d637'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:19.615849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f5fe359aca4be3a2e609465298d637'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:19.627590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f5fe359aca4be3a2e609465298d637'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:19.628447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f5fe359aca4be3a2e609465298d637'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:19.642062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 935/1863] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:18 2022] DELETE /identity/v3/users/c7f5fe359aca4be3a2e609465298d637 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:19.802195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:19.904532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab8d05-a568-48fa-b4b2-4fef2a8b5663 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:19.906575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3cab8d05-a568-48fa-b4b2-4fef2a8b5663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:19.928757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:19.937879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:19.939457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:20.023531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab8d05-a568-48fa-b4b2-4fef2a8b5663 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:20.101635 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904326cb-f5d0-4e0c-a1e6-b9f81df3a3a3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:20.111649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:20.112553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:20.113586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:20.116098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] PATH_INFO: `/v3/projects/4241c5f57c3a4aeca455faec5f9c75f2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:20.116098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4241c5f57c3a4aeca455faec5f9c75f2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:20.118009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:20.121140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f59bb7-a3f3-4181-9877-cbbe47f30dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:20.121792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f59bb7-a3f3-4181-9877-cbbe47f30dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:20.122079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f59bb7-a3f3-4181-9877-cbbe47f30dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:20.122357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f59bb7-a3f3-4181-9877-cbbe47f30dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:20.130424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-02f59bb7-a3f3-4181-9877-cbbe47f30dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:20.286277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f59bb7-a3f3-4181-9877-cbbe47f30dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:20.290192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f59bb7-a3f3-4181-9877-cbbe47f30dc2 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:20.313843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 929/1864] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:20.393736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4241c5f57c3a4aeca455faec5f9c75f2', 'request_id': 'req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:20.521520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4241c5f57c3a4aeca455faec5f9c75f2', 'request_id': 'req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:20.529481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4241c5f57c3a4aeca455faec5f9c75f2', 'request_id': 'req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:20.554711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] The token cache is being invalidate because project 4241c5f57c3a4aeca455faec5f9c75f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:20.555099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:20.555881 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cca3a81d-ce7c-46b4-b7a5-adebaf4bbd97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:20.557963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 936/1865] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:19 2022] DELETE /identity/v3/projects/4241c5f57c3a4aeca455faec5f9c75f2 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:20.566065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82725-6476-4adf-b850-fecd44b82cf7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:20.566371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82725-6476-4adf-b850-fecd44b82cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:20.567837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82725-6476-4adf-b850-fecd44b82cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:20.632994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7bb82725-6476-4adf-b850-fecd44b82cf7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:20.647121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7bb82725-6476-4adf-b850-fecd44b82cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:20.823526 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 930/1866] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:20.832228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f25e3-56c2-40dd-bd61-c0a4255ac528 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:20.832610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f25e3-56c2-40dd-bd61-c0a4255ac528 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:20.833602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f25e3-56c2-40dd-bd61-c0a4255ac528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:20.893090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-190f25e3-56c2-40dd-bd61-c0a4255ac528 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:20.894437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-190f25e3-56c2-40dd-bd61-c0a4255ac528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:20.914625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 937/1867] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:20.918707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb82725-6476-4adf-b850-fecd44b82cf7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:20.930036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb82725-6476-4adf-b850-fecd44b82cf7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:20.945236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:20.946161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:20.946718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:20.947138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:20.949837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:20.950355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:20.953907 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:20.981173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 931/1868] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:20.985529 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f25e3-56c2-40dd-bd61-c0a4255ac528 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:21.006973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f25e3-56c2-40dd-bd61-c0a4255ac528 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:21.029509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96248faa-d4db-4a51-a3f8-091ab5c4f0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:21.036177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248faa-d4db-4a51-a3f8-091ab5c4f0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.041302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248faa-d4db-4a51-a3f8-091ab5c4f0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.041302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96248faa-d4db-4a51-a3f8-091ab5c4f0ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.041302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96248faa-d4db-4a51-a3f8-091ab5c4f0ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:21.045294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96248faa-d4db-4a51-a3f8-091ab5c4f0ee admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:21.101489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:21.105094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:21.124054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867758e-e8b9-4800-bd2b-f7c8927d8020 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:21.132816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:21.133703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.135179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.136203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] PATH_INFO: `/v3/users/6387f1a2c416482aac59828068fda5bf` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.138256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6387f1a2c416482aac59828068fda5bf)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:21.140923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:21.178031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 938/1869] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:20 2022] POST /identity/v3/projects => generated 363 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:21.189777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96248faa-d4db-4a51-a3f8-091ab5c4f0ee admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:21.312445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96248faa-d4db-4a51-a3f8-091ab5c4f0ee admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:21.318549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:21.319510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.320011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.320580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.321938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:21.341539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:21.457570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6387f1a2c416482aac59828068fda5bf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:21.460271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6387f1a2c416482aac59828068fda5bf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:21.504168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 939/1870] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:21 2022] POST /identity/v3/users => generated 282 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:21.508311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:21.514633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:21.595548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6387f1a2c416482aac59828068fda5bf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:21.599386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6387f1a2c416482aac59828068fda5bf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:21.618424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f3aba-c3f3-4038-8002-c59fa6def22b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:21.631340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8303531-ad7b-4256-852b-3e2426049ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:21.631340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303531-ad7b-4256-852b-3e2426049ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.631340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303531-ad7b-4256-852b-3e2426049ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.631780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8303531-ad7b-4256-852b-3e2426049ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.643031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e8303531-ad7b-4256-852b-3e2426049ec6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:21.643230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6387f1a2c416482aac59828068fda5bf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:21.668627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 932/1871] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:21 2022] DELETE /identity/v3/users/6387f1a2c416482aac59828068fda5bf => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:21.673604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:21.673604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:21.729473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8303531-ad7b-4256-852b-3e2426049ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:21.731346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8303531-ad7b-4256-852b-3e2426049ec6 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:21.743662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 940/1872] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:21.745226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274fc4-c33f-4b47-9675-696163fc59c0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.746870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274fc4-c33f-4b47-9675-696163fc59c0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.748096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3274fc4-c33f-4b47-9675-696163fc59c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.776801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461bc55-33cc-4607-bf8d-d16a5c778ea4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:21.777826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b3274fc4-c33f-4b47-9675-696163fc59c0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:21.779458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b3274fc4-c33f-4b47-9675-696163fc59c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:21.794037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:21.795033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.795822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.796701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.797457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:21.814213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:21.814309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 941/1873] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:21.814309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274fc4-c33f-4b47-9675-696163fc59c0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:21.814309 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b3274fc4-c33f-4b47-9675-696163fc59c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:21.827771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 933/1874] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:21.830138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:21.836916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3274fc4-c33f-4b47-9675-696163fc59c0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:21.839219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:21.852564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:21.853227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.853513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.853788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] PATH_INFO: `/v3/users/831190b97d2c4f36bfbaaf444ff20ab5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.855202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831190b97d2c4f36bfbaaf444ff20ab5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:21.857367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:21.931972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cc699-7dc8-4b3e-8cb2-1254e83ff814 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:21.936045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41790-5e3f-4157-9863-1743e13f49e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:21.936776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41790-5e3f-4157-9863-1743e13f49e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.937134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41790-5e3f-4157-9863-1743e13f49e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.937492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee41790-5e3f-4157-9863-1743e13f49e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.948047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee41790-5e3f-4157-9863-1743e13f49e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:21.952687 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee41790-5e3f-4157-9863-1743e13f49e5 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:21.964223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 934/1875] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:21.965262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41790-5e3f-4157-9863-1743e13f49e5 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:21.976624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee41790-5e3f-4157-9863-1743e13f49e5 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:21.982116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b95fdd-f5f5-4ba1-9847-e55bf55f7705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:21.984322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95fdd-f5f5-4ba1-9847-e55bf55f7705 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:21.984796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95fdd-f5f5-4ba1-9847-e55bf55f7705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:21.985223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b95fdd-f5f5-4ba1-9847-e55bf55f7705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:21.986021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b95fdd-f5f5-4ba1-9847-e55bf55f7705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:21.988543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b95fdd-f5f5-4ba1-9847-e55bf55f7705 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:22.005064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 935/1876] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:22.005995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b95fdd-f5f5-4ba1-9847-e55bf55f7705 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:22.016470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b95fdd-f5f5-4ba1-9847-e55bf55f7705 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:22.025278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:22.026084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:22.026780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:22.027225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] PATH_INFO: `/v3/projects/83745396a56b411db9d72491f3754216/users/f1e30070170048fcb09bce2033dd2e76/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:22.047822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83745396a56b411db9d72491f3754216, user_id=f1e30070170048fcb09bce2033dd2e76, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:22.051343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:22.097461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831190b97d2c4f36bfbaaf444ff20ab5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.142065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 936/1877] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:22 2022] PUT /identity/v3/projects/83745396a56b411db9d72491f3754216/users/f1e30070170048fcb09bce2033dd2e76/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:22.143527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:22.146391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:22.223168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831190b97d2c4f36bfbaaf444ff20ab5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.224129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831190b97d2c4f36bfbaaf444ff20ab5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.248407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:22.276779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831190b97d2c4f36bfbaaf444ff20ab5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.278545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3f367ee7-f712-4a78-8bb4-65cf61771d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831190b97d2c4f36bfbaaf444ff20ab5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.301106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 942/1878] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:21 2022] DELETE /identity/v3/users/831190b97d2c4f36bfbaaf444ff20ab5 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:22.303206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c0b26-bf32-4e92-af46-c294ca80dde9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:22.303756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c0b26-bf32-4e92-af46-c294ca80dde9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:22.304237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c0b26-bf32-4e92-af46-c294ca80dde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:22.327276 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca769-b606-47ee-847d-db4aa372dcf8 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:22.343510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:22.409593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d28c0b26-bf32-4e92-af46-c294ca80dde9 None None] MFA Rules not processed for user `f1e30070170048fcb09bce2033dd2e76`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:22.419233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d28c0b26-bf32-4e92-af46-c294ca80dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:22.488986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:22.489827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:22.490211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:22.490579 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] PATH_INFO: `/v3/users/7a019d05c5a146ca8613e1a4306ddcc5` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:22.492146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a019d05c5a146ca8613e1a4306ddcc5)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:22.495417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:22.620174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 943/1879] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:22.621282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c0b26-bf32-4e92-af46-c294ca80dde9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:22.623217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d28c0b26-bf32-4e92-af46-c294ca80dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:22.639299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c0b26-bf32-4e92-af46-c294ca80dde9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:22.646830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:22.647576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:22.648535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:22.648901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:22.651375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:22.652752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:22.765337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 944/1880] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:22 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:22.767190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:22.780016 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:22.791523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a019d05c5a146ca8613e1a4306ddcc5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.792360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a019d05c5a146ca8613e1a4306ddcc5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.880711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a019d05c5a146ca8613e1a4306ddcc5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.881903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a019d05c5a146ca8613e1a4306ddcc5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.906833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a019d05c5a146ca8613e1a4306ddcc5'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:22.946686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 937/1881] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:22 2022] DELETE /identity/v3/users/7a019d05c5a146ca8613e1a4306ddcc5 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:22.954480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:22.959047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:22.959753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c9a4-b049-48c0-b20b-f89fe4778b86 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:23.069210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb443d34-300c-4ea7-87b3-28f557d52709 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:23.077168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:23.077811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:23.082459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:23.082730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:23.083758 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:23.086220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:23.114783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:23.120213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:23.125061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:23.125810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] PATH_INFO: `/v3/projects/c532d1f2cc9647d9a76deb9071f5f675` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:23.128443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c532d1f2cc9647d9a76deb9071f5f675)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:23.130795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:23.278682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 938/1882] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:22 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:23.280305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:23.282300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:23.291099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c532d1f2cc9647d9a76deb9071f5f675', 'request_id': 'req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:23.315199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1478211-8ee8-41c8-8984-f13f44f92884 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:23.389198 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c532d1f2cc9647d9a76deb9071f5f675', 'request_id': 'req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:23.402087 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c532d1f2cc9647d9a76deb9071f5f675', 'request_id': 'req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:23.442642 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:23.510175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:23.510175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:23.510175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] PATH_INFO: `/v3/projects/32740723d2a14728ac1122156e5e3ae5` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:23.512270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] The token cache is being invalidate because project c532d1f2cc9647d9a76deb9071f5f675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:23.512270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:23.512924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32740723d2a14728ac1122156e5e3ae5)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:23.513079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-91e74ed8-59c5-4167-ba4d-537b6d74fb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:23.513233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:23.513378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 945/1883] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:22 2022] DELETE /identity/v3/projects/c532d1f2cc9647d9a76deb9071f5f675 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:23.513378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cf52-b30b-479a-802e-3fe4625f18bd None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:23.513378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cf52-b30b-479a-802e-3fe4625f18bd None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:23.513378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04cf52-b30b-479a-802e-3fe4625f18bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:23.513378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6c04cf52-b30b-479a-802e-3fe4625f18bd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:23.513378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6c04cf52-b30b-479a-802e-3fe4625f18bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:23.514132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 946/1884] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:23.514132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04cf52-b30b-479a-802e-3fe4625f18bd None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:23.514132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6c04cf52-b30b-479a-802e-3fe4625f18bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:23.526595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04cf52-b30b-479a-802e-3fe4625f18bd None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:23.532804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:23.534073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:23.534346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:23.535242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:23.536132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:23.538521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:23.556242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 947/1885] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:23.557283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:23.563464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:23.610056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a5e9d-d2ea-4e5d-b084-2e2443124119 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:23.621814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:23.623091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:23.623502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:23.624252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] PATH_INFO: `/v3/users/de406a34d29b4388b4b67c63a91c4eb9` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:23.625757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de406a34d29b4388b4b67c63a91c4eb9)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:23.631121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:23.833398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32740723d2a14728ac1122156e5e3ae5', 'request_id': 'req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.298010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32740723d2a14728ac1122156e5e3ae5', 'request_id': 'req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.305930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32740723d2a14728ac1122156e5e3ae5', 'request_id': 'req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.316594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] The token cache is being invalidate because project 32740723d2a14728ac1122156e5e3ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:24.316883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.317557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.323277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 939/1886] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:23 2022] DELETE /identity/v3/projects/32740723d2a14728ac1122156e5e3ae5 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:24.323277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:24.323277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:24.368986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de406a34d29b4388b4b67c63a91c4eb9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.399094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42b768-9e3d-48f5-a9a0-b6c83459d9f2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:24.404719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fb206-ce68-4a7d-98ec-32860f90d426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:24.408075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fb206-ce68-4a7d-98ec-32860f90d426 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:24.408075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fb206-ce68-4a7d-98ec-32860f90d426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:24.408075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fb206-ce68-4a7d-98ec-32860f90d426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:24.408075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-144fb206-ce68-4a7d-98ec-32860f90d426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:24.476493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de406a34d29b4388b4b67c63a91c4eb9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.478167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de406a34d29b4388b4b67c63a91c4eb9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.499871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de406a34d29b4388b4b67c63a91c4eb9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.501387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de406a34d29b4388b4b67c63a91c4eb9'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:24.527766 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 948/1887] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:23 2022] DELETE /identity/v3/users/de406a34d29b4388b4b67c63a91c4eb9 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:24.531989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:24.533423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:24.540769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fb206-ce68-4a7d-98ec-32860f90d426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:24.544035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fb206-ce68-4a7d-98ec-32860f90d426 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:24.560160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 940/1888] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:24.561682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b468a-5fb0-4428-9bbe-bd833de78df1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:24.562051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b468a-5fb0-4428-9bbe-bd833de78df1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:24.562432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b468a-5fb0-4428-9bbe-bd833de78df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:24.606329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-030b468a-5fb0-4428-9bbe-bd833de78df1 None None] MFA Rules not processed for user `e1239200e38e499bb36153a0eb813c72`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:24.609508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-030b468a-5fb0-4428-9bbe-bd833de78df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:24.675693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659fa61-56b5-4eb2-9459-ce48d5db655c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:24.689501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e02478-0f46-4c9b-a72e-6512cde5e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:24.690562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e02478-0f46-4c9b-a72e-6512cde5e8df admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:24.690824 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e02478-0f46-4c9b-a72e-6512cde5e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:24.690962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e02478-0f46-4c9b-a72e-6512cde5e8df admin admin] PATH_INFO: `/v3/projects/e59df67e0d5d4469ba6d376ac333e707/users/d85660b7e7374ec38e9f74d4d740697d/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:24.718084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e02478-0f46-4c9b-a72e-6512cde5e8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59df67e0d5d4469ba6d376ac333e707, user_id=d85660b7e7374ec38e9f74d4d740697d, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:24.721974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e02478-0f46-4c9b-a72e-6512cde5e8df admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:24.745110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 941/1889] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:24.746638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4534-3fb2-48da-9482-930f9815b8c3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:24.746931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4534-3fb2-48da-9482-930f9815b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:24.747676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4534-3fb2-48da-9482-930f9815b8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:24.781891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4a0c4534-3fb2-48da-9482-930f9815b8c3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:24.783109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4a0c4534-3fb2-48da-9482-930f9815b8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:24.791879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 942/1890] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:24.792705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c4534-3fb2-48da-9482-930f9815b8c3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:24.794001 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4a0c4534-3fb2-48da-9482-930f9815b8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:24.870327 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 949/1891] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:24 2022] PUT /identity/v3/projects/e59df67e0d5d4469ba6d376ac333e707/users/d85660b7e7374ec38e9f74d4d740697d/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:24.870516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c4534-3fb2-48da-9482-930f9815b8c3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:24.871951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc2bd-4c49-46ed-bebe-3c6190cade46 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:24.872311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc2bd-4c49-46ed-bebe-3c6190cade46 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:24.872523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc2bd-4c49-46ed-bebe-3c6190cade46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:24.893377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-abfcc2bd-4c49-46ed-bebe-3c6190cade46 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:24.895257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-abfcc2bd-4c49-46ed-bebe-3c6190cade46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:24.985809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d737-bafb-42a9-aa70-20903ddf615f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:24.986827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d737-bafb-42a9-aa70-20903ddf615f service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:24.987214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d737-bafb-42a9-aa70-20903ddf615f service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:24.988286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854d737-bafb-42a9-aa70-20903ddf615f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.037186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:25.038811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 950/1892] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:25.039556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcc2bd-4c49-46ed-bebe-3c6190cade46 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:25.063038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcc2bd-4c49-46ed-bebe-3c6190cade46 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:25.085685 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f816fe-5be7-419e-90b3-c8869a53d9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:25.086251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f816fe-5be7-419e-90b3-c8869a53d9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:25.086535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f816fe-5be7-419e-90b3-c8869a53d9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:25.086814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f816fe-5be7-419e-90b3-c8869a53d9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.087475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f816fe-5be7-419e-90b3-c8869a53d9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:25.090567 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f816fe-5be7-419e-90b3-c8869a53d9c7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:25.106410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 951/1893] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:25.107355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f816fe-5be7-419e-90b3-c8869a53d9c7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:25.116022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854d737-bafb-42a9-aa70-20903ddf615f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:25.119396 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854d737-bafb-42a9-aa70-20903ddf615f service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:25.119699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f816fe-5be7-419e-90b3-c8869a53d9c7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:25.125407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:25.139002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:25.139002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:25.139002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.139002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:25.139002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:25.139002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:25.141621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 943/1894] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:25.142332 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d737-bafb-42a9-aa70-20903ddf615f service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:25.155711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 952/1895] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:25.161673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:25.162548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854d737-bafb-42a9-aa70-20903ddf615f service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:25.176698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39800d-809d-4d0d-9c82-b1f2d5b2a845 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:25.177626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effaf98-6950-48bc-b728-21a9498ecfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:25.178519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effaf98-6950-48bc-b728-21a9498ecfcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:25.178880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effaf98-6950-48bc-b728-21a9498ecfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:25.179232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effaf98-6950-48bc-b728-21a9498ecfcb admin admin] PATH_INFO: `/v3/projects/e59df67e0d5d4469ba6d376ac333e707/users/d85660b7e7374ec38e9f74d4d740697d/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.182975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effaf98-6950-48bc-b728-21a9498ecfcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59df67e0d5d4469ba6d376ac333e707, user_id=d85660b7e7374ec38e9f74d4d740697d, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:25.185565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:25.185565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:25.185565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:25.185565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.185966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:25.187372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effaf98-6950-48bc-b728-21a9498ecfcb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:25.188293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:25.225060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 944/1896] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:25 2022] PUT /identity/v3/projects/e59df67e0d5d4469ba6d376ac333e707/users/d85660b7e7374ec38e9f74d4d740697d/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:25.227746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672cabe-7ee2-4d3d-9c61-e8ba5e8670e4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:25.227943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672cabe-7ee2-4d3d-9c61-e8ba5e8670e4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:25.231431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672cabe-7ee2-4d3d-9c61-e8ba5e8670e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.271312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0672cabe-7ee2-4d3d-9c61-e8ba5e8670e4 None None] MFA Rules not processed for user `d85660b7e7374ec38e9f74d4d740697d`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:25.271312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0672cabe-7ee2-4d3d-9c61-e8ba5e8670e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:25.353871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 953/1897] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:25 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:25.356224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:25.359445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:25.370242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 945/1898] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:25.370242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672cabe-7ee2-4d3d-9c61-e8ba5e8670e4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:25.380835 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0672cabe-7ee2-4d3d-9c61-e8ba5e8670e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:25.467983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa161ea-b7d0-4581-adc4-94ede0071ccf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:25.473682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:25.474580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:25.475442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:25.475942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] PATH_INFO: `/v3/projects/4a60db30fb9343c381d5844fae87671a` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.477907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a60db30fb9343c381d5844fae87671a)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:25.480977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:25.495391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672cabe-7ee2-4d3d-9c61-e8ba5e8670e4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:25.509499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:25.510424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:25.510849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:25.511311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] PATH_INFO: `/v3/projects/2bf9c11e19e54ae7afc4ff095733f537` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.513349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf9c11e19e54ae7afc4ff095733f537)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:25.515770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:25.635917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a60db30fb9343c381d5844fae87671a', 'request_id': 'req-615c022c-fec5-4bdb-af5f-0db5c80a45b3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.685970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf9c11e19e54ae7afc4ff095733f537', 'request_id': 'req-758e3acb-c1f7-447e-8556-3a34665a0a26'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.773853 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a60db30fb9343c381d5844fae87671a', 'request_id': 'req-615c022c-fec5-4bdb-af5f-0db5c80a45b3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.783013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a60db30fb9343c381d5844fae87671a', 'request_id': 'req-615c022c-fec5-4bdb-af5f-0db5c80a45b3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.806426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] The token cache is being invalidate because project 4a60db30fb9343c381d5844fae87671a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:25.806980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.807882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.812977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 954/1899] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:25 2022] DELETE /identity/v3/projects/4a60db30fb9343c381d5844fae87671a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:25.812977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:25.812977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:25.898492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c022c-fec5-4bdb-af5f-0db5c80a45b3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:25.922079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf9c11e19e54ae7afc4ff095733f537', 'request_id': 'req-758e3acb-c1f7-447e-8556-3a34665a0a26'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.932549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf9c11e19e54ae7afc4ff095733f537', 'request_id': 'req-758e3acb-c1f7-447e-8556-3a34665a0a26'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.945549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] The token cache is being invalidate because project 2bf9c11e19e54ae7afc4ff095733f537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:25.945853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.946501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:25.951693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 946/1900] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:25 2022] DELETE /identity/v3/projects/2bf9c11e19e54ae7afc4ff095733f537 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:25.952667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:25.953952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:25.968920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fbce8-f9cc-4912-95fd-d781ae4b3263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:25.969543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbce8-f9cc-4912-95fd-d781ae4b3263 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:25.970273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbce8-f9cc-4912-95fd-d781ae4b3263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:25.970273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fbce8-f9cc-4912-95fd-d781ae4b3263 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:25.970761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fbce8-f9cc-4912-95fd-d781ae4b3263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:25.973499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fbce8-f9cc-4912-95fd-d781ae4b3263 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.017585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e3acb-c1f7-447e-8556-3a34665a0a26 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.022528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb03d0-acf2-4605-8f5a-71beea11103d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.023239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb03d0-acf2-4605-8f5a-71beea11103d service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.023520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb03d0-acf2-4605-8f5a-71beea11103d service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.023832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb03d0-acf2-4605-8f5a-71beea11103d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.026124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1fb03d0-acf2-4605-8f5a-71beea11103d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:26.099418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb03d0-acf2-4605-8f5a-71beea11103d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.101608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb03d0-acf2-4605-8f5a-71beea11103d service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.111297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 947/1901] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:26.113561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3f4d-b231-47ed-b363-43b668db6f93 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.113833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3f4d-b231-47ed-b363-43b668db6f93 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.114307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3f4d-b231-47ed-b363-43b668db6f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.127588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 955/1902] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:25 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:26.130143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca481c-edec-40c5-b127-fffa37906f19 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.133816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca481c-edec-40c5-b127-fffa37906f19 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.134145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca481c-edec-40c5-b127-fffa37906f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.138372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-60ef3f4d-b231-47ed-b363-43b668db6f93 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:26.140478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-60ef3f4d-b231-47ed-b363-43b668db6f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:26.156478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 948/1903] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:26.163965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-30ca481c-edec-40c5-b127-fffa37906f19 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:26.164209 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3f4d-b231-47ed-b363-43b668db6f93 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.165186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-30ca481c-edec-40c5-b127-fffa37906f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:26.166460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-60ef3f4d-b231-47ed-b363-43b668db6f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:26.173671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 956/1904] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:26.174867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cbbc9-12c4-4a74-baf1-335925c1d9a8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.175879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cbbc9-12c4-4a74-baf1-335925c1d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.183793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7cbbc9-12c4-4a74-baf1-335925c1d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.191358 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef3f4d-b231-47ed-b363-43b668db6f93 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.196776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbb43d-cb6b-4387-b098-e563fe830048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.198200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8b7cbbc9-12c4-4a74-baf1-335925c1d9a8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:26.199335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb43d-cb6b-4387-b098-e563fe830048 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.199638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8b7cbbc9-12c4-4a74-baf1-335925c1d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:26.199773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb43d-cb6b-4387-b098-e563fe830048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.200521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbb43d-cb6b-4387-b098-e563fe830048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.201392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbb43d-cb6b-4387-b098-e563fe830048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.203018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbb43d-cb6b-4387-b098-e563fe830048 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.222483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 949/1905] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:26.222483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf355-7774-465e-b931-89b36876ee4e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.222483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf355-7774-465e-b931-89b36876ee4e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.222483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaf355-7774-465e-b931-89b36876ee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.238947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 957/1906] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:26.239868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cbbc9-12c4-4a74-baf1-335925c1d9a8 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.254094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-88aaf355-7774-465e-b931-89b36876ee4e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:26.255873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-88aaf355-7774-465e-b931-89b36876ee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:26.256375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7cbbc9-12c4-4a74-baf1-335925c1d9a8 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.262363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344f208-6024-4c05-8a4b-aacc85f0c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.263324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344f208-6024-4c05-8a4b-aacc85f0c41d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.263795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344f208-6024-4c05-8a4b-aacc85f0c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.264285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344f208-6024-4c05-8a4b-aacc85f0c41d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.265732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344f208-6024-4c05-8a4b-aacc85f0c41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.268742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344f208-6024-4c05-8a4b-aacc85f0c41d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.271806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 950/1907] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:26.272254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaf355-7774-465e-b931-89b36876ee4e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.295349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaf355-7774-465e-b931-89b36876ee4e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.301760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.301760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.301760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.301760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.302142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:26.302217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 958/1908] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:26.302297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.302365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344f208-6024-4c05-8a4b-aacc85f0c41d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.303389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.329216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 951/1909] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:26.329216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.329887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344f208-6024-4c05-8a4b-aacc85f0c41d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.337420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.341127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.341127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.341127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.341127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:26.341127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.342941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.344146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee8878-ffdb-4f5a-9f9e-38a6d01d4977 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.354431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21c90-18b8-4614-971d-59ed536aff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.355244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21c90-18b8-4614-971d-59ed536aff6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.355536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21c90-18b8-4614-971d-59ed536aff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.355852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21c90-18b8-4614-971d-59ed536aff6d admin admin] PATH_INFO: `/v3/projects/31e7647e8c034063ba242a624e9fcb37/users/fb1ae95760a84778861e52e0fa3e52c3/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.364028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 959/1910] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:26.364028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.374043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f8113-9a54-4aee-8925-e2a946b11e4c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.385295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21c90-18b8-4614-971d-59ed536aff6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e7647e8c034063ba242a624e9fcb37, user_id=fb1ae95760a84778861e52e0fa3e52c3, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.386879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757273c0-898e-45cf-8bd6-d94534ad2b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.387513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757273c0-898e-45cf-8bd6-d94534ad2b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.390522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21c90-18b8-4614-971d-59ed536aff6d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.391988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757273c0-898e-45cf-8bd6-d94534ad2b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.392528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757273c0-898e-45cf-8bd6-d94534ad2b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.394728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757273c0-898e-45cf-8bd6-d94534ad2b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.397466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757273c0-898e-45cf-8bd6-d94534ad2b2f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.547673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 952/1911] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:26 2022] PUT /identity/v3/projects/31e7647e8c034063ba242a624e9fcb37/users/fb1ae95760a84778861e52e0fa3e52c3/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:26.562667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21c90-18b8-4614-971d-59ed536aff6d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.611556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 960/1912] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/projects => generated 375 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:26.615834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e3a2-630c-45ce-96ab-d13658697a60 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.616105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e3a2-630c-45ce-96ab-d13658697a60 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.617105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164e3a2-630c-45ce-96ab-d13658697a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.650094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21c90-18b8-4614-971d-59ed536aff6d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.660173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6164e3a2-630c-45ce-96ab-d13658697a60 None None] MFA Rules not processed for user `fb1ae95760a84778861e52e0fa3e52c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:26.662625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6164e3a2-630c-45ce-96ab-d13658697a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:26.684134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:26.716109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0cf60-bf68-4116-b260-1aa59cbc7fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.716730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0cf60-bf68-4116-b260-1aa59cbc7fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.717143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0cf60-bf68-4116-b260-1aa59cbc7fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.717461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0cf60-bf68-4116-b260-1aa59cbc7fe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.718125 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0cf60-bf68-4116-b260-1aa59cbc7fe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.720053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0cf60-bf68-4116-b260-1aa59cbc7fe6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.749811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 961/1913] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:26.750720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164e3a2-630c-45ce-96ab-d13658697a60 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.808875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164e3a2-630c-45ce-96ab-d13658697a60 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:26.813118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:26.813732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:26.814018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:26.814302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:26.816876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:26.884230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:26.885639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:26.899656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 953/1914] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/projects => generated 385 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:26.899656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0cf60-bf68-4116-b260-1aa59cbc7fe6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.904858 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 962/1915] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:26.905485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:26.928047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba7b9b-5825-4d79-bac6-974531411695 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.017286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0cf60-bf68-4116-b260-1aa59cbc7fe6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.017778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.018689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.019998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.020338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.021047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.024196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.025894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ac94a-bfd0-4da2-abe0-14b5434d5099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.026693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ac94a-bfd0-4da2-abe0-14b5434d5099 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.027155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ac94a-bfd0-4da2-abe0-14b5434d5099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.027586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ac94a-bfd0-4da2-abe0-14b5434d5099 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.028378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ac94a-bfd0-4da2-abe0-14b5434d5099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.030747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ac94a-bfd0-4da2-abe0-14b5434d5099 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.169369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 963/1916] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:27.169961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:27.171673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:27.218547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 954/1917] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:26 2022] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:27.223431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ac94a-bfd0-4da2-abe0-14b5434d5099 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:27.238829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ac94a-bfd0-4da2-abe0-14b5434d5099 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.248817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa19b1b-ef64-4c05-afdb-527150abc3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.249583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19b1b-ef64-4c05-afdb-527150abc3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.249973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19b1b-ef64-4c05-afdb-527150abc3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.250500 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa19b1b-ef64-4c05-afdb-527150abc3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.251557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa19b1b-ef64-4c05-afdb-527150abc3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.255677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa19b1b-ef64-4c05-afdb-527150abc3f9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.261525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696590ce-2b67-4fa7-8a3f-c089afbcec2d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.265716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b86ab7-6a55-499f-a673-604302408858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.266342 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86ab7-6a55-499f-a673-604302408858 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.266627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86ab7-6a55-499f-a673-604302408858 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.266907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86ab7-6a55-499f-a673-604302408858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.277239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 955/1918] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:27.277239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa19b1b-ef64-4c05-afdb-527150abc3f9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:27.288401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa19b1b-ef64-4c05-afdb-527150abc3f9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.294682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264e01-d3f5-4b4b-8cef-eb4f1ce93f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.295306 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264e01-d3f5-4b4b-8cef-eb4f1ce93f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.295586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264e01-d3f5-4b4b-8cef-eb4f1ce93f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.295976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f264e01-d3f5-4b4b-8cef-eb4f1ce93f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.296648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f264e01-d3f5-4b4b-8cef-eb4f1ce93f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.298310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f264e01-d3f5-4b4b-8cef-eb4f1ce93f97 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.312827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 956/1919] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:27.313787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264e01-d3f5-4b4b-8cef-eb4f1ce93f97 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:27.325733 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f264e01-d3f5-4b4b-8cef-eb4f1ce93f97 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.341615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760726a9-6560-46a9-a9dd-90f88379ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.342299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760726a9-6560-46a9-a9dd-90f88379ec23 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.342581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760726a9-6560-46a9-a9dd-90f88379ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.342906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760726a9-6560-46a9-a9dd-90f88379ec23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.343574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760726a9-6560-46a9-a9dd-90f88379ec23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.345279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760726a9-6560-46a9-a9dd-90f88379ec23 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.350640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b86ab7-6a55-499f-a673-604302408858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.353122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b86ab7-6a55-499f-a673-604302408858 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.357590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 957/1920] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:27.358726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760726a9-6560-46a9-a9dd-90f88379ec23 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:27.371227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 964/1921] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:27.373090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b86ab7-6a55-499f-a673-604302408858 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:27.387596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760726a9-6560-46a9-a9dd-90f88379ec23 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.389318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b86ab7-6a55-499f-a673-604302408858 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.395794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb56bc-69a4-428a-b3fb-ee08086bb5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.396684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb56bc-69a4-428a-b3fb-ee08086bb5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.397044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb56bc-69a4-428a-b3fb-ee08086bb5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.397490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb56bc-69a4-428a-b3fb-ee08086bb5c7 admin admin] PATH_INFO: `/v3/projects/e59f22f6f2c342e8a3b1156e33d811c5/users/43fac1d9797b4639b3bd843866fa2912/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.400090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd776-df3d-4cc0-b984-9f0edc699f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.400729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd776-df3d-4cc0-b984-9f0edc699f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.401014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd776-df3d-4cc0-b984-9f0edc699f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.401292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd776-df3d-4cc0-b984-9f0edc699f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.401964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bd776-df3d-4cc0-b984-9f0edc699f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.403595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bd776-df3d-4cc0-b984-9f0edc699f31 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.420074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb56bc-69a4-428a-b3fb-ee08086bb5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59f22f6f2c342e8a3b1156e33d811c5, user_id=43fac1d9797b4639b3bd843866fa2912, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.423704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb56bc-69a4-428a-b3fb-ee08086bb5c7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.437331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 958/1922] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:27.438243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd776-df3d-4cc0-b984-9f0edc699f31 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:27.478368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd776-df3d-4cc0-b984-9f0edc699f31 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.495702 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5aedf-994b-4ce0-bef9-36963bcd4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.496722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5aedf-994b-4ce0-bef9-36963bcd4dce admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.497047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5aedf-994b-4ce0-bef9-36963bcd4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.497417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5aedf-994b-4ce0-bef9-36963bcd4dce admin admin] PATH_INFO: `/v3/projects/4928d2be525f4fc88aa0402890035939/users/29ba9f4e33754a48bbca28ba211cb02e/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.529729 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5aedf-994b-4ce0-bef9-36963bcd4dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4928d2be525f4fc88aa0402890035939, user_id=29ba9f4e33754a48bbca28ba211cb02e, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.530713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 965/1923] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:27 2022] PUT /identity/v3/projects/e59f22f6f2c342e8a3b1156e33d811c5/users/43fac1d9797b4639b3bd843866fa2912/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:27.532986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5aedf-994b-4ce0-bef9-36963bcd4dce admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:27.542937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba988-be37-49f5-a4e2-537df45ab925 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.544270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba988-be37-49f5-a4e2-537df45ab925 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.544552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ba988-be37-49f5-a4e2-537df45ab925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.549193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:27.594051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d14ba988-be37-49f5-a4e2-537df45ab925 None None] MFA Rules not processed for user `43fac1d9797b4639b3bd843866fa2912`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:27.596645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d14ba988-be37-49f5-a4e2-537df45ab925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:27.631839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 959/1924] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:27 2022] PUT /identity/v3/projects/4928d2be525f4fc88aa0402890035939/users/29ba9f4e33754a48bbca28ba211cb02e/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:27.639420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b845-e5a5-4e08-be3f-732b916bdd09 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.639779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b845-e5a5-4e08-be3f-732b916bdd09 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.640201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000b845-e5a5-4e08-be3f-732b916bdd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.675097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9000b845-e5a5-4e08-be3f-732b916bdd09 None None] MFA Rules not processed for user `29ba9f4e33754a48bbca28ba211cb02e`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:27.677541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9000b845-e5a5-4e08-be3f-732b916bdd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:27.691664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 966/1925] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:27.696514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ba988-be37-49f5-a4e2-537df45ab925 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:27.800040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 960/1926] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:27.803212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ba988-be37-49f5-a4e2-537df45ab925 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:27.903619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d72118-94ef-4a19-b92a-915c1c7c2706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:27.904301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72118-94ef-4a19-b92a-915c1c7c2706 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:27.904564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72118-94ef-4a19-b92a-915c1c7c2706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:27.904848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72118-94ef-4a19-b92a-915c1c7c2706 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:27.905499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d72118-94ef-4a19-b92a-915c1c7c2706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:27.907417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d72118-94ef-4a19-b92a-915c1c7c2706 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:28.004590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 967/1927] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:27 2022] POST /identity/v3/projects => generated 381 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:28.008549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000b845-e5a5-4e08-be3f-732b916bdd09 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:28.020469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000b845-e5a5-4e08-be3f-732b916bdd09 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:28.098055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde7db-31eb-44c2-977c-3c59a014952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:28.098797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde7db-31eb-44c2-977c-3c59a014952d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.099150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde7db-31eb-44c2-977c-3c59a014952d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.099521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bde7db-31eb-44c2-977c-3c59a014952d admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.100319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bde7db-31eb-44c2-977c-3c59a014952d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:28.102697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bde7db-31eb-44c2-977c-3c59a014952d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:28.230429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 961/1928] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:28 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:28.234459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d72118-94ef-4a19-b92a-915c1c7c2706 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:28.252190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d72118-94ef-4a19-b92a-915c1c7c2706 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:28.264527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9e9f0-5ddb-4192-8568-540a6e2f8c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:28.265246 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e9f0-5ddb-4192-8568-540a6e2f8c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.265869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e9f0-5ddb-4192-8568-540a6e2f8c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.276865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9e9f0-5ddb-4192-8568-540a6e2f8c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.277727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9e9f0-5ddb-4192-8568-540a6e2f8c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:28.288654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9e9f0-5ddb-4192-8568-540a6e2f8c39 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:28.292145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde7db-31eb-44c2-977c-3c59a014952d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:28.315583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 968/1929] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:28.320569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9e9f0-5ddb-4192-8568-540a6e2f8c39 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:28.351670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9e9f0-5ddb-4192-8568-540a6e2f8c39 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:28.358657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251b73b-5cfa-4646-97d8-1b1067ab4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:28.359603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b73b-5cfa-4646-97d8-1b1067ab4a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.359939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b73b-5cfa-4646-97d8-1b1067ab4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.360190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251b73b-5cfa-4646-97d8-1b1067ab4a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.361478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251b73b-5cfa-4646-97d8-1b1067ab4a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:28.364764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251b73b-5cfa-4646-97d8-1b1067ab4a35 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:28.385945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 969/1930] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:28.386914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251b73b-5cfa-4646-97d8-1b1067ab4a35 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:28.401311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251b73b-5cfa-4646-97d8-1b1067ab4a35 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:28.407304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3113f-066f-4ace-bd79-3c37e575a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:28.414397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3113f-066f-4ace-bd79-3c37e575a866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.414397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3113f-066f-4ace-bd79-3c37e575a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.414397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3113f-066f-4ace-bd79-3c37e575a866 admin admin] PATH_INFO: `/v3/projects/7c6cb99b6c8d4bfe9356a59cef2e56d2/users/ea7269c3c8ec4020b6bb4a3075738bd1/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.425029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bde7db-31eb-44c2-977c-3c59a014952d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:28.429081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3113f-066f-4ace-bd79-3c37e575a866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6cb99b6c8d4bfe9356a59cef2e56d2, user_id=ea7269c3c8ec4020b6bb4a3075738bd1, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:28.431766 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3113f-066f-4ace-bd79-3c37e575a866 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:28.432771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022dd58-5438-4a63-b3c4-d01a9db64010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:28.433497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dd58-5438-4a63-b3c4-d01a9db64010 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.435382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dd58-5438-4a63-b3c4-d01a9db64010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.435762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022dd58-5438-4a63-b3c4-d01a9db64010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.523318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 970/1931] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:28 2022] PUT /identity/v3/projects/7c6cb99b6c8d4bfe9356a59cef2e56d2/users/ea7269c3c8ec4020b6bb4a3075738bd1/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:28.525276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef302c8-09d7-4c85-b77a-c82106408aa4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.525565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022dd58-5438-4a63-b3c4-d01a9db64010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:28.525674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef302c8-09d7-4c85-b77a-c82106408aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.526105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef302c8-09d7-4c85-b77a-c82106408aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.527014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022dd58-5438-4a63-b3c4-d01a9db64010 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:28.539890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 962/1932] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:28.541410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c649663-bccf-4905-af9e-6653af66d9ef None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.541798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c649663-bccf-4905-af9e-6653af66d9ef None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.542076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c649663-bccf-4905-af9e-6653af66d9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.568394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1ef302c8-09d7-4c85-b77a-c82106408aa4 None None] MFA Rules not processed for user `e1239200e38e499bb36153a0eb813c72`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:28.586324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1ef302c8-09d7-4c85-b77a-c82106408aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:28.593239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7c649663-bccf-4905-af9e-6653af66d9ef None None] MFA Rules not processed for user `ea7269c3c8ec4020b6bb4a3075738bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:28.597873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7c649663-bccf-4905-af9e-6653af66d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:28.672317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 971/1933] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:28.689915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 963/1934] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:28.695432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef302c8-09d7-4c85-b77a-c82106408aa4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:28.781356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef302c8-09d7-4c85-b77a-c82106408aa4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:28.788736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c649663-bccf-4905-af9e-6653af66d9ef None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:28.790542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7c649663-bccf-4905-af9e-6653af66d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:28.792276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7009119-20e4-4fff-968b-6afa17268807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:28.793387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7009119-20e4-4fff-968b-6afa17268807 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.794187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7009119-20e4-4fff-968b-6afa17268807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.794480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7009119-20e4-4fff-968b-6afa17268807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.795162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7009119-20e4-4fff-968b-6afa17268807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:28.798456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7009119-20e4-4fff-968b-6afa17268807 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:28.820348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c649663-bccf-4905-af9e-6653af66d9ef None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:28.841672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:28.842403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:28.842707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:28.845140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] PATH_INFO: `/v3/users/df2c571b8c6246f2a0466fd94b1d3104` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:28.848646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2c571b8c6246f2a0466fd94b1d3104)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:28.851546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:29.016214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 972/1935] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:28 2022] POST /identity/v3/projects => generated 385 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:29.020957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7009119-20e4-4fff-968b-6afa17268807 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:29.086305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7009119-20e4-4fff-968b-6afa17268807 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:29.090988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1bd6e-f7ab-42c2-aa55-0e26e7a10fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:29.091595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bd6e-f7ab-42c2-aa55-0e26e7a10fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.091904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bd6e-f7ab-42c2-aa55-0e26e7a10fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.092386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1bd6e-f7ab-42c2-aa55-0e26e7a10fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.092823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1bd6e-f7ab-42c2-aa55-0e26e7a10fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:29.094731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1bd6e-f7ab-42c2-aa55-0e26e7a10fb9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:29.118312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2c571b8c6246f2a0466fd94b1d3104'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:29.118973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2c571b8c6246f2a0466fd94b1d3104'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:29.218444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2c571b8c6246f2a0466fd94b1d3104'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:29.221345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2c571b8c6246f2a0466fd94b1d3104'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:29.229669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 973/1936] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:29 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:29.233751 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b6f0-85df-4678-a5bf-cb22a9cc320f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.234266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b6f0-85df-4678-a5bf-cb22a9cc320f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.234401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b6f0-85df-4678-a5bf-cb22a9cc320f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-fba6b6f0-85df-4678-a5bf-cb22a9cc320f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:18:29.241070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:29.241898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:18:29.242683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 974/1937] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:18:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:18:29.243351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6b6f0-85df-4678-a5bf-cb22a9cc320f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:29.244903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-02c1a0d1-4630-4800-991a-8b64dc9eaf8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2c571b8c6246f2a0466fd94b1d3104'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:29.246015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fba6b6f0-85df-4678-a5bf-cb22a9cc320f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:29.268048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6b6f0-85df-4678-a5bf-cb22a9cc320f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:29.275774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845da5e-5000-47d3-beb5-a32f10883411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:29.276294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845da5e-5000-47d3-beb5-a32f10883411 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.276674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845da5e-5000-47d3-beb5-a32f10883411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.277249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845da5e-5000-47d3-beb5-a32f10883411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.278074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845da5e-5000-47d3-beb5-a32f10883411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:29.281739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845da5e-5000-47d3-beb5-a32f10883411 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:29.283160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 964/1938] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:28 2022] DELETE /identity/v3/users/df2c571b8c6246f2a0466fd94b1d3104 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:29.288738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283a27-7f95-4bf4-bdbe-92ec6b437c2a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.289032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283a27-7f95-4bf4-bdbe-92ec6b437c2a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.289306 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283a27-7f95-4bf4-bdbe-92ec6b437c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.295752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 975/1939] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:29.297919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845da5e-5000-47d3-beb5-a32f10883411 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:29.308200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9d283a27-7f95-4bf4-bdbe-92ec6b437c2a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:29.308941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845da5e-5000-47d3-beb5-a32f10883411 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:29.309404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9d283a27-7f95-4bf4-bdbe-92ec6b437c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:29.393360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83b09-df35-4ff4-8127-be35a0202ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:29.393489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 965/1940] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:29.393577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83b09-df35-4ff4-8127-be35a0202ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.393577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83b09-df35-4ff4-8127-be35a0202ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.393577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e83b09-df35-4ff4-8127-be35a0202ce5 admin admin] PATH_INFO: `/v3/projects/acf3e043901e4e109cd960f602e62adb/users/14737ab763234447b5bc4b0d98ab1208/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.400259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d283a27-7f95-4bf4-bdbe-92ec6b437c2a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:29.402644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9d283a27-7f95-4bf4-bdbe-92ec6b437c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:29.405797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e83b09-df35-4ff4-8127-be35a0202ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf3e043901e4e109cd960f602e62adb, user_id=14737ab763234447b5bc4b0d98ab1208, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:29.409215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e83b09-df35-4ff4-8127-be35a0202ce5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:29.509658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d283a27-7f95-4bf4-bdbe-92ec6b437c2a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:29.514880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd529b-c2ca-44ec-9041-5fb4dc6fe970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:29.515641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd529b-c2ca-44ec-9041-5fb4dc6fe970 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.516065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd529b-c2ca-44ec-9041-5fb4dc6fe970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.516428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd529b-c2ca-44ec-9041-5fb4dc6fe970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.527864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd529b-c2ca-44ec-9041-5fb4dc6fe970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:29.529614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd529b-c2ca-44ec-9041-5fb4dc6fe970 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:29.565065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 966/1941] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:18:29.579301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 976/1942] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:29 2022] PUT /identity/v3/projects/acf3e043901e4e109cd960f602e62adb/users/14737ab763234447b5bc4b0d98ab1208/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:29.584047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd529b-c2ca-44ec-9041-5fb4dc6fe970 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:29.595081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd529b-c2ca-44ec-9041-5fb4dc6fe970 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:29.670822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12397c6-b63f-41e8-b4c8-ac29859d8240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:29.672236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12397c6-b63f-41e8-b4c8-ac29859d8240 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.672677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12397c6-b63f-41e8-b4c8-ac29859d8240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.673504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12397c6-b63f-41e8-b4c8-ac29859d8240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.673760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12397c6-b63f-41e8-b4c8-ac29859d8240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:29.675682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12397c6-b63f-41e8-b4c8-ac29859d8240 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:29.704879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 967/1943] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:29.711063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83b09-df35-4ff4-8127-be35a0202ce5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:29.734594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e83b09-df35-4ff4-8127-be35a0202ce5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:29.747055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:29.747758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.748099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.748383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] PATH_INFO: `/v3/projects/acf3e043901e4e109cd960f602e62adb/users/14737ab763234447b5bc4b0d98ab1208/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.750557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf3e043901e4e109cd960f602e62adb, user_id=14737ab763234447b5bc4b0d98ab1208, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:29.754159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=1,keystone:SELECT=93,keystone:INSERT=6 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:29.756603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:29.770912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 977/1944] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:29 2022] PUT /identity/v3/projects/acf3e043901e4e109cd960f602e62adb/users/14737ab763234447b5bc4b0d98ab1208/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:29.781424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb848-018b-43c6-a959-7f1483a1693d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:29.782734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb848-018b-43c6-a959-7f1483a1693d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:29.783494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cb848-018b-43c6-a959-7f1483a1693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:29.836728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6e8cb848-018b-43c6-a959-7f1483a1693d None None] MFA Rules not processed for user `14737ab763234447b5bc4b0d98ab1208`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:29.838565 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6e8cb848-018b-43c6-a959-7f1483a1693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:29.946482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 968/1945] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:30.266065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:30.268014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:30.321716 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cb848-018b-43c6-a959-7f1483a1693d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:30.323298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6e8cb848-018b-43c6-a959-7f1483a1693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:30.378886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28b075-1d02-49af-983e-920282aba22d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:30.378886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:30.378886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:30.378886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:30.379380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:30.391847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:30.508965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cb848-018b-43c6-a959-7f1483a1693d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:30.516781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:30.517452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:30.517903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:30.518337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] PATH_INFO: `/v3/projects/7421b868a07248128527486fd639591d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:30.519711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:30.520930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7421b868a07248128527486fd639591d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:30.521404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:30.522902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:30.536740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 978/1946] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:30.538570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:30.539997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:30.556042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b6ceb-9e57-47fe-8b60-461d9f5b9aec service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:30.561549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:30.562436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:30.562934 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:30.570734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] PATH_INFO: `/v3/users/6ced7205b5864273990c128820e1f795` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:30.570734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ced7205b5864273990c128820e1f795)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:30.570734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:30.745988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7421b868a07248128527486fd639591d', 'request_id': 'req-521d3b74-50df-4deb-8ce4-6dd0d29b3616'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:30.857759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7421b868a07248128527486fd639591d', 'request_id': 'req-521d3b74-50df-4deb-8ce4-6dd0d29b3616'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:30.862017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:30.867096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7421b868a07248128527486fd639591d', 'request_id': 'req-521d3b74-50df-4deb-8ce4-6dd0d29b3616'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:30.869716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ced7205b5864273990c128820e1f795'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:30.883353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] The token cache is being invalidate because project 7421b868a07248128527486fd639591d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:30.883654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:30.884376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:30.885971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 969/1947] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:30 2022] DELETE /identity/v3/projects/7421b868a07248128527486fd639591d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:30.889933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:30.891388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:30.964973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d3b74-50df-4deb-8ce4-6dd0d29b3616 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:30.970161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:30.974896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:30.974896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:30.974896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] PATH_INFO: `/v3/users/f2018817e56a4cf396caf1cffd880684` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:30.974896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2018817e56a4cf396caf1cffd880684)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:30.975221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:30.990281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ced7205b5864273990c128820e1f795'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:30.990914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ced7205b5864273990c128820e1f795'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:31.009620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ced7205b5864273990c128820e1f795'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:31.010562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-15435542-979c-4cbf-a3ad-119fd9646c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ced7205b5864273990c128820e1f795'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:31.026819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 979/1948] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:30 2022] DELETE /identity/v3/users/6ced7205b5864273990c128820e1f795 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:31.031708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e6bd-fdb0-4573-a79c-9804b27f0c97 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:31.032214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e6bd-fdb0-4573-a79c-9804b27f0c97 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:31.032493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9e6bd-fdb0-4573-a79c-9804b27f0c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:31.055917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e5c9e6bd-fdb0-4573-a79c-9804b27f0c97 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:31.055917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e5c9e6bd-fdb0-4573-a79c-9804b27f0c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:31.114681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 980/1949] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:31.124443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e6bd-fdb0-4573-a79c-9804b27f0c97 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:31.125887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e5c9e6bd-fdb0-4573-a79c-9804b27f0c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:31.190061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9e6bd-fdb0-4573-a79c-9804b27f0c97 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:31.195334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:31.196006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:31.196325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:31.196602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:31.200490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2018817e56a4cf396caf1cffd880684'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:31.201168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2018817e56a4cf396caf1cffd880684'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:31.217122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:31.218628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:31.229971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 981/1950] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:18:31.279564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2018817e56a4cf396caf1cffd880684'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:31.280282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2018817e56a4cf396caf1cffd880684'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:31.293134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2018817e56a4cf396caf1cffd880684'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:31.307859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 970/1951] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:30 2022] DELETE /identity/v3/users/f2018817e56a4cf396caf1cffd880684 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:31.841215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:31.859272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:31.861784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:31.882151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423e67-68bc-4531-868c-01addacd6887 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:31.906233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:31.910095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:31.971483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:31.972933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:31.973161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:31.974150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] PATH_INFO: `/v3/projects/f9b45f9e9a8443d8b0b9919faeda01bc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:31.977648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b45f9e9a8443d8b0b9919faeda01bc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:31.978326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:32.021099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046085-bc16-41a8-b888-ea8aca0aeae7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:32.025998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:32.027212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:32.027212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:32.027428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] PATH_INFO: `/v3/projects/fc414b6c365d4327bf78cc7a939633ac` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:32.029050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc414b6c365d4327bf78cc7a939633ac)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:32.030954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:32.110970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b45f9e9a8443d8b0b9919faeda01bc', 'request_id': 'req-8374122f-b2f4-44f3-b0b3-ad72a508a52a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.182404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b45f9e9a8443d8b0b9919faeda01bc', 'request_id': 'req-8374122f-b2f4-44f3-b0b3-ad72a508a52a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.204062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b45f9e9a8443d8b0b9919faeda01bc', 'request_id': 'req-8374122f-b2f4-44f3-b0b3-ad72a508a52a'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.210421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc414b6c365d4327bf78cc7a939633ac', 'request_id': 'req-461dc40e-3106-4ad2-be45-056616e43eb4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.220515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] The token cache is being invalidate because project f9b45f9e9a8443d8b0b9919faeda01bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:32.220818 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.221490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.224123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 982/1952] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:31 2022] DELETE /identity/v3/projects/f9b45f9e9a8443d8b0b9919faeda01bc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:32.228426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:32.229778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:32.299670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374122f-b2f4-44f3-b0b3-ad72a508a52a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:32.310796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc414b6c365d4327bf78cc7a939633ac', 'request_id': 'req-461dc40e-3106-4ad2-be45-056616e43eb4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.325206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc414b6c365d4327bf78cc7a939633ac', 'request_id': 'req-461dc40e-3106-4ad2-be45-056616e43eb4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.350672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] The token cache is being invalidate because project fc414b6c365d4327bf78cc7a939633ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:32.351647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.352616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.355157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 971/1953] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:31 2022] DELETE /identity/v3/projects/fc414b6c365d4327bf78cc7a939633ac => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:32.359982 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:32.361029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:32.408186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:32.408995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:32.410218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:32.410218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] PATH_INFO: `/v3/users/a082433cb6324acaba5e5b4f4e8b8e81` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:32.411360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a082433cb6324acaba5e5b4f4e8b8e81)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:32.413331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:32.435412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461dc40e-3106-4ad2-be45-056616e43eb4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:32.442030 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:32.442752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:32.443205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:32.443498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] PATH_INFO: `/v3/users/4fef8128b33a4790ac58f3adf232c28d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:32.444872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fef8128b33a4790ac58f3adf232c28d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:32.446981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:32.673485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a082433cb6324acaba5e5b4f4e8b8e81'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.724706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fef8128b33a4790ac58f3adf232c28d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.725766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fef8128b33a4790ac58f3adf232c28d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.761076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a082433cb6324acaba5e5b4f4e8b8e81'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.762025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a082433cb6324acaba5e5b4f4e8b8e81'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.776957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a082433cb6324acaba5e5b4f4e8b8e81'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.777701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a082433cb6324acaba5e5b4f4e8b8e81'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.806723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 983/1954] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:32 2022] DELETE /identity/v3/users/a082433cb6324acaba5e5b4f4e8b8e81 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:32.821795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fef8128b33a4790ac58f3adf232c28d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.822596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fef8128b33a4790ac58f3adf232c28d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.844398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:32.845982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:32.851754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fef8128b33a4790ac58f3adf232c28d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:32.884622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 972/1955] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:32 2022] DELETE /identity/v3/users/4fef8128b33a4790ac58f3adf232c28d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:32.990290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d07d02-d2fe-4bff-985d-c74eee0c8e9a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:33.114639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:33.115618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:33.115618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:33.116102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] PATH_INFO: `/v3/users/f1e30070170048fcb09bce2033dd2e76` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:33.117084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e30070170048fcb09bce2033dd2e76)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:33.119045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:33.152669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:33.382766 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e30070170048fcb09bce2033dd2e76'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.457307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:33.460839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:33.481472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e30070170048fcb09bce2033dd2e76'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.482364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e30070170048fcb09bce2033dd2e76'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.498869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e30070170048fcb09bce2033dd2e76'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.499793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e30070170048fcb09bce2033dd2e76'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.530827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 984/1956] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:32 2022] DELETE /identity/v3/users/f1e30070170048fcb09bce2033dd2e76 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:33.530827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:33.531501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:33.549497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c715c8-778b-492a-89d0-d1fdfdd3cecf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:33.629147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef5bc3-e102-477c-adbe-7dd143aeafca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:33.629773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5bc3-e102-477c-adbe-7dd143aeafca service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:33.630055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5bc3-e102-477c-adbe-7dd143aeafca service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:33.630505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef5bc3-e102-477c-adbe-7dd143aeafca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:33.632453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-32ef5bc3-e102-477c-adbe-7dd143aeafca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:33.651195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ac0cc-262f-4690-902e-bab8afa38132 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:33.666101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:33.666101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:33.666101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:33.666101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] PATH_INFO: `/v3/projects/312f55300bbd47d6aa4bc900db4e5532` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:33.667192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] RBAC: Authorizing `identity:delete_project(project_id=312f55300bbd47d6aa4bc900db4e5532)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:33.667192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:33.698479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef5bc3-e102-477c-adbe-7dd143aeafca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:33.700010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef5bc3-e102-477c-adbe-7dd143aeafca service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:33.709466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 973/1957] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:18:33.710839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b41b-bb02-47f1-825a-1f8a3efa133f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:33.711134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b41b-bb02-47f1-825a-1f8a3efa133f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:33.711413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5b41b-bb02-47f1-825a-1f8a3efa133f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:33.732698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-80e5b41b-bb02-47f1-825a-1f8a3efa133f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:33.733940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-80e5b41b-bb02-47f1-825a-1f8a3efa133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:33.745967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 974/1958] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:33.745967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5b41b-bb02-47f1-825a-1f8a3efa133f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:33.745967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-80e5b41b-bb02-47f1-825a-1f8a3efa133f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:33.758224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5b41b-bb02-47f1-825a-1f8a3efa133f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:33.763539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:33.764296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:33.764656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:33.764990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] PATH_INFO: `/v3/projects/9a507bc00c6345de8986ca2b2f40041c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:33.766317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a507bc00c6345de8986ca2b2f40041c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:33.768246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:33.779079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312f55300bbd47d6aa4bc900db4e5532', 'request_id': 'req-0059a8d5-d44b-45fd-88dc-dd87194b204b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.795407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:33.881624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312f55300bbd47d6aa4bc900db4e5532', 'request_id': 'req-0059a8d5-d44b-45fd-88dc-dd87194b204b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.890143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312f55300bbd47d6aa4bc900db4e5532', 'request_id': 'req-0059a8d5-d44b-45fd-88dc-dd87194b204b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.907026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] The token cache is being invalidate because project 312f55300bbd47d6aa4bc900db4e5532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:33.907592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.908563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0059a8d5-d44b-45fd-88dc-dd87194b204b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.911705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a507bc00c6345de8986ca2b2f40041c', 'request_id': 'req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:33.911849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 985/1959] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:33 2022] DELETE /identity/v3/projects/312f55300bbd47d6aa4bc900db4e5532 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:33.913757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd821ff-07e5-48d9-86f8-274ce837912e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:33.914227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd821ff-07e5-48d9-86f8-274ce837912e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:33.914826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd821ff-07e5-48d9-86f8-274ce837912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:33.935601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0bd821ff-07e5-48d9-86f8-274ce837912e None None] MFA Rules not processed for user `e1239200e38e499bb36153a0eb813c72`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:33.936851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0bd821ff-07e5-48d9-86f8-274ce837912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:33.995740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 986/1960] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:33.996617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd821ff-07e5-48d9-86f8-274ce837912e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:33.997889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0bd821ff-07e5-48d9-86f8-274ce837912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:34.023889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a507bc00c6345de8986ca2b2f40041c', 'request_id': 'req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:34.033203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a507bc00c6345de8986ca2b2f40041c', 'request_id': 'req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:34.047884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] The token cache is being invalidate because project 9a507bc00c6345de8986ca2b2f40041c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:34.048329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:34.048983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d9724ba4-ddf0-4cb1-8e8d-e11a6ceefe82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:34.057256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 975/1961] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:33 2022] DELETE /identity/v3/projects/9a507bc00c6345de8986ca2b2f40041c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:34.057256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878373-8693-46cc-9050-79249b5fb04c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.057256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878373-8693-46cc-9050-79249b5fb04c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.057256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5878373-8693-46cc-9050-79249b5fb04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.082980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd821ff-07e5-48d9-86f8-274ce837912e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.088431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa4798-9328-47e6-9e31-77d34cce36cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.090158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa4798-9328-47e6-9e31-77d34cce36cc service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.090364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa4798-9328-47e6-9e31-77d34cce36cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.090966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa4798-9328-47e6-9e31-77d34cce36cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.093376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b5878373-8693-46cc-9050-79249b5fb04c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:34.094195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b5878373-8693-46cc-9050-79249b5fb04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:34.094518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-76fa4798-9328-47e6-9e31-77d34cce36cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:34.192926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa4798-9328-47e6-9e31-77d34cce36cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.195263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa4798-9328-47e6-9e31-77d34cce36cc service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.210753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 987/1962] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:34.216618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf0204-975f-4403-a850-737794993602 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.216618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf0204-975f-4403-a850-737794993602 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.216618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf0204-975f-4403-a850-737794993602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.249082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3daf0204-975f-4403-a850-737794993602 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:34.250936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3daf0204-975f-4403-a850-737794993602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:34.260918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 988/1963] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:34.270444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef120f6-8816-43e7-99d3-1d8688f30e20 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.270615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef120f6-8816-43e7-99d3-1d8688f30e20 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.270987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 976/1964] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:34.272126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef120f6-8816-43e7-99d3-1d8688f30e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.288583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2647-8448-45af-b543-e91c908b2659 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.289110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2647-8448-45af-b543-e91c908b2659 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.289593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b2647-8448-45af-b543-e91c908b2659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.326900 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-760b2647-8448-45af-b543-e91c908b2659 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:34.328950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-760b2647-8448-45af-b543-e91c908b2659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:34.330562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-eef120f6-8816-43e7-99d3-1d8688f30e20 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:34.332721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eef120f6-8816-43e7-99d3-1d8688f30e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:34.339178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 977/1965] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:34.344627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b2647-8448-45af-b543-e91c908b2659 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.354187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 989/1966] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:34.354838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b2647-8448-45af-b543-e91c908b2659 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.360717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.361201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef120f6-8816-43e7-99d3-1d8688f30e20 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.361362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.361623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.361898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.362589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:34.362894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.364816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.382862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef120f6-8816-43e7-99d3-1d8688f30e20 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.383675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 978/1967] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:34.384781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.388722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.389469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.389761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.390037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.395669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:34.396054 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.401557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.401749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e23f4-995b-47ba-9cd6-2d3048d1ed0e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.410699 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00098-b625-4c58-aea0-63481ef9931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.421720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 990/1968] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:34.422038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00098-b625-4c58-aea0-63481ef9931d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.422038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00098-b625-4c58-aea0-63481ef9931d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.422038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00098-b625-4c58-aea0-63481ef9931d admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.422038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e00098-b625-4c58-aea0-63481ef9931d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.427009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.428166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e00098-b625-4c58-aea0-63481ef9931d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.448131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c49c2-bbeb-4d9d-9c51-d365ce13fde3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.460434 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c9a37-a98d-43b1-830f-d692862a5e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.461213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c9a37-a98d-43b1-830f-d692862a5e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.461573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c9a37-a98d-43b1-830f-d692862a5e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.461930 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c9a37-a98d-43b1-830f-d692862a5e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.462822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c9a37-a98d-43b1-830f-d692862a5e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.465491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c9a37-a98d-43b1-830f-d692862a5e43 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.588305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 979/1969] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/projects => generated 397 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:34.588514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 991/1970] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:34.588610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5f137-9835-4ea8-86e6-73b92e617908 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.588610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5f137-9835-4ea8-86e6-73b92e617908 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.588610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5f137-9835-4ea8-86e6-73b92e617908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.590530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c9a37-a98d-43b1-830f-d692862a5e43 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3dc5f137-9835-4ea8-86e6-73b92e617908 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:18:34.595981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:34.597936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:18:34.598885 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 980/1971] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:18:34.600374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5f137-9835-4ea8-86e6-73b92e617908 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.728943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c9a37-a98d-43b1-830f-d692862a5e43 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.740643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fe061-6326-402f-9442-361f1a4cefa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.740643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe061-6326-402f-9442-361f1a4cefa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.740857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe061-6326-402f-9442-361f1a4cefa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.741243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe061-6326-402f-9442-361f1a4cefa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.743351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5f137-9835-4ea8-86e6-73b92e617908 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.743748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fe061-6326-402f-9442-361f1a4cefa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.746324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fe061-6326-402f-9442-361f1a4cefa6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.749465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212565-aed5-478b-af42-cee3fba67c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.751530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212565-aed5-478b-af42-cee3fba67c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.752194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212565-aed5-478b-af42-cee3fba67c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.752611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be212565-aed5-478b-af42-cee3fba67c70 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.753961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be212565-aed5-478b-af42-cee3fba67c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.757114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be212565-aed5-478b-af42-cee3fba67c70 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.895091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 981/1972] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:34.895548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 992/1973] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:34 2022] POST /identity/v3/users => generated 288 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:34.896580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212565-aed5-478b-af42-cee3fba67c70 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.897848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fe061-6326-402f-9442-361f1a4cefa6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.907102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be212565-aed5-478b-af42-cee3fba67c70 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.907919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fe061-6326-402f-9442-361f1a4cefa6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.912669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860dc40-04dc-4367-90f8-b4d13b04b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.913225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860dc40-04dc-4367-90f8-b4d13b04b5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.913509 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860dc40-04dc-4367-90f8-b4d13b04b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.913666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8caf22-4b9d-419c-b5d7-93ee7a60558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.913806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860dc40-04dc-4367-90f8-b4d13b04b5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.914432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860dc40-04dc-4367-90f8-b4d13b04b5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.914758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8caf22-4b9d-419c-b5d7-93ee7a60558c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.915043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8caf22-4b9d-419c-b5d7-93ee7a60558c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.915321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8caf22-4b9d-419c-b5d7-93ee7a60558c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.916003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8caf22-4b9d-419c-b5d7-93ee7a60558c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.916097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d860dc40-04dc-4367-90f8-b4d13b04b5b8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.917614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8caf22-4b9d-419c-b5d7-93ee7a60558c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.927184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 982/1974] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:34.929039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 993/1975] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:34.931737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860dc40-04dc-4367-90f8-b4d13b04b5b8 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.932770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8caf22-4b9d-419c-b5d7-93ee7a60558c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.943364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860dc40-04dc-4367-90f8-b4d13b04b5b8 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.943469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8caf22-4b9d-419c-b5d7-93ee7a60558c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:34.950692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.951015 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3ae9-deaa-47c3-8483-fe9c360aca54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:34.951442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.951753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.951955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3ae9-deaa-47c3-8483-fe9c360aca54 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:34.952052 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.952409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3ae9-deaa-47c3-8483-fe9c360aca54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:34.952676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.952884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf3ae9-deaa-47c3-8483-fe9c360aca54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:34.953655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf3ae9-deaa-47c3-8483-fe9c360aca54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:34.954263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.955877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf3ae9-deaa-47c3-8483-fe9c360aca54 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:34.968195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 983/1976] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:34.968887 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.970578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:34.973498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 994/1977] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:34.974676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3ae9-deaa-47c3-8483-fe9c360aca54 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:34.987276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf3ae9-deaa-47c3-8483-fe9c360aca54 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:35.001827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1441-863e-4b11-9985-66a0a8187c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:35.004268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1441-863e-4b11-9985-66a0a8187c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:35.005917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1441-863e-4b11-9985-66a0a8187c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:35.006413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b1441-863e-4b11-9985-66a0a8187c99 admin admin] PATH_INFO: `/v3/projects/dcf7717e320e4246b36fa2bc4ec3bbb0/users/934908057b4e44b59d279e2617082fc6/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:35.016977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad73c7-7609-4974-8785-ead3a957ec7c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:35.026087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:35.026824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:35.027179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:35.027552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] PATH_INFO: `/v3/projects/83745396a56b411db9d72491f3754216` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:35.029141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=83745396a56b411db9d72491f3754216)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:35.037074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:35.042423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1441-863e-4b11-9985-66a0a8187c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf7717e320e4246b36fa2bc4ec3bbb0, user_id=934908057b4e44b59d279e2617082fc6, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:35.045326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b1441-863e-4b11-9985-66a0a8187c99 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:35.214133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 995/1978] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:34 2022] PUT /identity/v3/projects/dcf7717e320e4246b36fa2bc4ec3bbb0/users/934908057b4e44b59d279e2617082fc6/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:35.221019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1441-863e-4b11-9985-66a0a8187c99 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:35.228297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83745396a56b411db9d72491f3754216', 'request_id': 'req-daa1217f-544f-4fa0-91e8-e0515678fe9f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.312159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b1441-863e-4b11-9985-66a0a8187c99 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:35.317318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83745396a56b411db9d72491f3754216', 'request_id': 'req-daa1217f-544f-4fa0-91e8-e0515678fe9f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.328748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83745396a56b411db9d72491f3754216', 'request_id': 'req-daa1217f-544f-4fa0-91e8-e0515678fe9f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.352461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:35.356501 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] The token cache is being invalidate because project 83745396a56b411db9d72491f3754216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:35.367465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.369736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.375800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 984/1979] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:34 2022] DELETE /identity/v3/projects/83745396a56b411db9d72491f3754216 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:35.377796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:35.384361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:35.419799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b854e5-8a10-4ab8-842f-b01661c58935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:35.420029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b854e5-8a10-4ab8-842f-b01661c58935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:35.420248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b854e5-8a10-4ab8-842f-b01661c58935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:35.420536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b854e5-8a10-4ab8-842f-b01661c58935 admin admin] PATH_INFO: `/v3/projects/13474245b33e49bfad5d827e2b178e91/users/6e3eac29be1347ac8519791212346e7f/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:35.441883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b854e5-8a10-4ab8-842f-b01661c58935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13474245b33e49bfad5d827e2b178e91, user_id=6e3eac29be1347ac8519791212346e7f, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:35.447447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b854e5-8a10-4ab8-842f-b01661c58935 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:35.511673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1217f-544f-4fa0-91e8-e0515678fe9f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:35.524047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:35.524047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:35.524047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:35.524047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] PATH_INFO: `/v3/users/29ba9f4e33754a48bbca28ba211cb02e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:35.525897 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ba9f4e33754a48bbca28ba211cb02e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:35.528780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:35.557158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:35.560745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 996/1980] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:35 2022] PUT /identity/v3/projects/13474245b33e49bfad5d827e2b178e91/users/6e3eac29be1347ac8519791212346e7f/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:35.563637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc64f2-dddd-4229-9d79-1b1ebf792b8c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:35.564040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc64f2-dddd-4229-9d79-1b1ebf792b8c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:35.568236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc64f2-dddd-4229-9d79-1b1ebf792b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:35.621267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c4dc64f2-dddd-4229-9d79-1b1ebf792b8c None None] MFA Rules not processed for user `934908057b4e44b59d279e2617082fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:35.623476 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c4dc64f2-dddd-4229-9d79-1b1ebf792b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:35.713814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 997/1981] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:35.714688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc64f2-dddd-4229-9d79-1b1ebf792b8c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:35.716110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c4dc64f2-dddd-4229-9d79-1b1ebf792b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:35.790249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc64f2-dddd-4229-9d79-1b1ebf792b8c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:35.796332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:35.796985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:35.797271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:35.797551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] PATH_INFO: `/v3/users/d85660b7e7374ec38e9f74d4d740697d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:35.799376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85660b7e7374ec38e9f74d4d740697d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:35.802292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:35.809606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ba9f4e33754a48bbca28ba211cb02e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.810412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ba9f4e33754a48bbca28ba211cb02e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.880851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ba9f4e33754a48bbca28ba211cb02e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.881618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ba9f4e33754a48bbca28ba211cb02e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.895398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dbb7bf02-d150-4d79-bc77-4261efb8191a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ba9f4e33754a48bbca28ba211cb02e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:35.909634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 985/1982] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:35 2022] DELETE /identity/v3/users/29ba9f4e33754a48bbca28ba211cb02e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:35.911287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415ae3-5c12-4516-b08c-5e1da7729625 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:35.911664 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415ae3-5c12-4516-b08c-5e1da7729625 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:35.912052 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415ae3-5c12-4516-b08c-5e1da7729625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:35.940352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f3415ae3-5c12-4516-b08c-5e1da7729625 None None] MFA Rules not processed for user `6e3eac29be1347ac8519791212346e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:35.942218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f3415ae3-5c12-4516-b08c-5e1da7729625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:36.006046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 986/1983] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:36.006899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415ae3-5c12-4516-b08c-5e1da7729625 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.008307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f3415ae3-5c12-4516-b08c-5e1da7729625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:36.065291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415ae3-5c12-4516-b08c-5e1da7729625 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.070783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.071402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.071683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.071993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.072850 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85660b7e7374ec38e9f74d4d740697d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:36.073711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:36.092615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:36.140388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.140938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.151612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 987/1984] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:36.152494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.153804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:36.196162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85660b7e7374ec38e9f74d4d740697d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:36.197108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85660b7e7374ec38e9f74d4d740697d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:36.210891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85660b7e7374ec38e9f74d4d740697d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:36.211616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8fbdbfd4-d5d6-4163-92f2-4dbab0ebf044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85660b7e7374ec38e9f74d4d740697d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:36.224507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 998/1985] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:35 2022] DELETE /identity/v3/users/d85660b7e7374ec38e9f74d4d740697d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:36.225769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b44b-1c86-4871-a114-ef9b533e25e1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.226256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b44b-1c86-4871-a114-ef9b533e25e1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.226796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65b44b-1c86-4871-a114-ef9b533e25e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.234717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d94198-4c73-498a-a97d-cbb61c69d7d5 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.247127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3d65b44b-1c86-4871-a114-ef9b533e25e1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:36.248361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3d65b44b-1c86-4871-a114-ef9b533e25e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:36.303613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.304311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.304566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.304842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.305480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.307474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.317467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 999/1986] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:36.321162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b44b-1c86-4871-a114-ef9b533e25e1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.321162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3d65b44b-1c86-4871-a114-ef9b533e25e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:36.333184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65b44b-1c86-4871-a114-ef9b533e25e1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.338659 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.339288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.339743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.340387 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.340696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.342643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.420213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 988/1987] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:36 2022] POST /identity/v3/projects => generated 399 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:36.421189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.422854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:36.479338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d763c-4468-4f15-85b2-eb0291ffb144 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.482927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92915196-c871-4b69-bb49-b33eda5f98cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.483573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92915196-c871-4b69-bb49-b33eda5f98cd service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.483891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92915196-c871-4b69-bb49-b33eda5f98cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.484165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92915196-c871-4b69-bb49-b33eda5f98cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.506867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1000/1988] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:36 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:36.510699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.512839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:36.560748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92915196-c871-4b69-bb49-b33eda5f98cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.562269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92915196-c871-4b69-bb49-b33eda5f98cd service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.575190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 989/1989] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:36.576063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92915196-c871-4b69-bb49-b33eda5f98cd service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.588314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92915196-c871-4b69-bb49-b33eda5f98cd service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.644005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e377c00-9fd8-400a-afc1-e787ab6df32e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.647689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521efb6-01b8-4e42-8ae7-2de3222c3636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.648275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521efb6-01b8-4e42-8ae7-2de3222c3636 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.648584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521efb6-01b8-4e42-8ae7-2de3222c3636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.648865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521efb6-01b8-4e42-8ae7-2de3222c3636 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.649603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521efb6-01b8-4e42-8ae7-2de3222c3636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.655246 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521efb6-01b8-4e42-8ae7-2de3222c3636 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.663017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe31628-bc5d-40a7-830a-66293c46e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.669804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31628-bc5d-40a7-830a-66293c46e66e admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.669804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31628-bc5d-40a7-830a-66293c46e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.669804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe31628-bc5d-40a7-830a-66293c46e66e admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.669804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe31628-bc5d-40a7-830a-66293c46e66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.669804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe31628-bc5d-40a7-830a-66293c46e66e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.758468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1001/1990] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:36 2022] POST /identity/v3/users => generated 306 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:36.765231 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521efb6-01b8-4e42-8ae7-2de3222c3636 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.778312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521efb6-01b8-4e42-8ae7-2de3222c3636 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.795635 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0891-3f8e-496f-a50d-c7c2177efb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.797110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0891-3f8e-496f-a50d-c7c2177efb55 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.797828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0891-3f8e-496f-a50d-c7c2177efb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.798781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b0891-3f8e-496f-a50d-c7c2177efb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.801536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0891-3f8e-496f-a50d-c7c2177efb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.803629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b0891-3f8e-496f-a50d-c7c2177efb55 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.819611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 990/1991] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:36 2022] POST /identity/v3/users => generated 295 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:36.824240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe31628-bc5d-40a7-830a-66293c46e66e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.829621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1002/1992] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:36.855354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe31628-bc5d-40a7-830a-66293c46e66e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.860395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0891-3f8e-496f-a50d-c7c2177efb55 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.862911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589b27c-f959-4282-9bb7-9e6a773ce2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.863545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589b27c-f959-4282-9bb7-9e6a773ce2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.863868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589b27c-f959-4282-9bb7-9e6a773ce2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.864146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589b27c-f959-4282-9bb7-9e6a773ce2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.864804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589b27c-f959-4282-9bb7-9e6a773ce2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.866658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589b27c-f959-4282-9bb7-9e6a773ce2f6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.876253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b0891-3f8e-496f-a50d-c7c2177efb55 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.881940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.882756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.883139 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.883482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] PATH_INFO: `/v3/projects/1c029a3442e54a9e9276c4f8f7a26288/users/18607988fb4a405fb54d240ad9873dad/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.889010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 991/1993] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:36.891360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589b27c-f959-4282-9bb7-9e6a773ce2f6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:36.913064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589b27c-f959-4282-9bb7-9e6a773ce2f6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:36.919046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304850c6-8a09-4db9-819c-a7626177291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:36.919760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304850c6-8a09-4db9-819c-a7626177291c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:36.920186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304850c6-8a09-4db9-819c-a7626177291c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:36.920467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304850c6-8a09-4db9-819c-a7626177291c admin admin] PATH_INFO: `/v3/projects/acfcdf89e7214663a9c675a7ced1f715/users/f3e9ae13e7494191b27bbcc753aba037/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:36.920974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c029a3442e54a9e9276c4f8f7a26288, user_id=18607988fb4a405fb54d240ad9873dad, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.924807 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:36.950842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304850c6-8a09-4db9-819c-a7626177291c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acfcdf89e7214663a9c675a7ced1f715, user_id=f3e9ae13e7494191b27bbcc753aba037, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:36.950842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304850c6-8a09-4db9-819c-a7626177291c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:37.027523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1003/1994] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:36 2022] PUT /identity/v3/projects/1c029a3442e54a9e9276c4f8f7a26288/users/18607988fb4a405fb54d240ad9873dad/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:37.027912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:37.030569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:37.099027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 992/1995] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:36 2022] PUT /identity/v3/projects/acfcdf89e7214663a9c675a7ced1f715/users/f3e9ae13e7494191b27bbcc753aba037/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:37.100076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304850c6-8a09-4db9-819c-a7626177291c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:37.113922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ee7ac-2414-45d4-8254-10f4d2f14662 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:37.193660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304850c6-8a09-4db9-819c-a7626177291c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:37.198697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:37.205643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d047-5fa3-4ce0-bdbb-60cc86fca60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:37.205793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.205793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.206936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d047-5fa3-4ce0-bdbb-60cc86fca60c admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.206936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d047-5fa3-4ce0-bdbb-60cc86fca60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.207260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] PATH_INFO: `/v3/projects/e59df67e0d5d4469ba6d376ac333e707` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.207260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59df67e0d5d4469ba6d376ac333e707)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:37.207260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:37.208129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052d047-5fa3-4ce0-bdbb-60cc86fca60c admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.208129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d047-5fa3-4ce0-bdbb-60cc86fca60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:37.209118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052d047-5fa3-4ce0-bdbb-60cc86fca60c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:37.220828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 993/1996] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:37.224300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d047-5fa3-4ce0-bdbb-60cc86fca60c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:37.239206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052d047-5fa3-4ce0-bdbb-60cc86fca60c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:37.250960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4611f9-2b7c-449d-b22a-799062f001fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:37.252527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4611f9-2b7c-449d-b22a-799062f001fd admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.253469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4611f9-2b7c-449d-b22a-799062f001fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.253892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4611f9-2b7c-449d-b22a-799062f001fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.256889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4611f9-2b7c-449d-b22a-799062f001fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:37.258995 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4611f9-2b7c-449d-b22a-799062f001fd admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:37.271821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 994/1997] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:37.271821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4611f9-2b7c-449d-b22a-799062f001fd admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:37.282810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4611f9-2b7c-449d-b22a-799062f001fd admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:37.291575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:37.291575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.291575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.291575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] PATH_INFO: `/v3/projects/1c029a3442e54a9e9276c4f8f7a26288/users/18607988fb4a405fb54d240ad9873dad/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.291959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c029a3442e54a9e9276c4f8f7a26288, user_id=18607988fb4a405fb54d240ad9873dad, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:37.294241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:37.306656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 995/1998] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:37 2022] PUT /identity/v3/projects/1c029a3442e54a9e9276c4f8f7a26288/users/18607988fb4a405fb54d240ad9873dad/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:37.307517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:37.309530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:37.406735 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9284c3-b390-4d4d-ab29-df5ef4607728 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:37.428048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59df67e0d5d4469ba6d376ac333e707', 'request_id': 'req-32b47fd7-bd34-4040-848b-763bd3fb9d1c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.482967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:37.483605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.483944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.484252 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] PATH_INFO: `/v3/projects/4928d2be525f4fc88aa0402890035939` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.485421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4928d2be525f4fc88aa0402890035939)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:37.492620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:37.515909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59df67e0d5d4469ba6d376ac333e707', 'request_id': 'req-32b47fd7-bd34-4040-848b-763bd3fb9d1c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.528256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59df67e0d5d4469ba6d376ac333e707', 'request_id': 'req-32b47fd7-bd34-4040-848b-763bd3fb9d1c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.544845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] The token cache is being invalidate because project e59df67e0d5d4469ba6d376ac333e707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:37.545146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.545971 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.552618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1004/1999] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:37 2022] DELETE /identity/v3/projects/e59df67e0d5d4469ba6d376ac333e707 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:37.553661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:37.555110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:37.569461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b47fd7-bd34-4040-848b-763bd3fb9d1c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:37.577037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77f2c2-ad98-4ff1-a78c-8f0591175186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:37.577728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f2c2-ad98-4ff1-a78c-8f0591175186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.578024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f2c2-ad98-4ff1-a78c-8f0591175186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.578301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f2c2-ad98-4ff1-a78c-8f0591175186 admin admin] PATH_INFO: `/v3/projects/acfcdf89e7214663a9c675a7ced1f715/users/f3e9ae13e7494191b27bbcc753aba037/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.580315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77f2c2-ad98-4ff1-a78c-8f0591175186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acfcdf89e7214663a9c675a7ced1f715, user_id=f3e9ae13e7494191b27bbcc753aba037, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:37.585285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77f2c2-ad98-4ff1-a78c-8f0591175186 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:37.594573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1005/2000] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:37 2022] PUT /identity/v3/projects/acfcdf89e7214663a9c675a7ced1f715/users/f3e9ae13e7494191b27bbcc753aba037/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:37.595916 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db380-eead-4809-a273-41b1f430c651 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.596207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db380-eead-4809-a273-41b1f430c651 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.596511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db380-eead-4809-a273-41b1f430c651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.633490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-436db380-eead-4809-a273-41b1f430c651 None None] MFA Rules not processed for user `18607988fb4a405fb54d240ad9873dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:37.635337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-436db380-eead-4809-a273-41b1f430c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:37.675939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4928d2be525f4fc88aa0402890035939', 'request_id': 'req-45f9b5d5-35d1-438f-b468-7397d63caf2a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.721133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1006/2001] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:37.723257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fbfcc-2b06-4df9-9400-48d1b68fe982 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.723650 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fbfcc-2b06-4df9-9400-48d1b68fe982 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.724028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fbfcc-2b06-4df9-9400-48d1b68fe982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.757549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b06fbfcc-2b06-4df9-9400-48d1b68fe982 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:37.757549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b06fbfcc-2b06-4df9-9400-48d1b68fe982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:37.777191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4928d2be525f4fc88aa0402890035939', 'request_id': 'req-45f9b5d5-35d1-438f-b468-7397d63caf2a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.792201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4928d2be525f4fc88aa0402890035939', 'request_id': 'req-45f9b5d5-35d1-438f-b468-7397d63caf2a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.810901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] The token cache is being invalidate because project 4928d2be525f4fc88aa0402890035939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:37.810901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.814625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-45f9b5d5-35d1-438f-b468-7397d63caf2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:37.822443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 996/2002] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:37 2022] DELETE /identity/v3/projects/4928d2be525f4fc88aa0402890035939 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:37.824119 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49df1e-36c3-4575-ad31-a1551d14a69d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.825112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49df1e-36c3-4575-ad31-a1551d14a69d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.829439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49df1e-36c3-4575-ad31-a1551d14a69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.858165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1007/2003] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:37.859463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fbfcc-2b06-4df9-9400-48d1b68fe982 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:37.868576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b06fbfcc-2b06-4df9-9400-48d1b68fe982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:37.891369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-de49df1e-36c3-4575-ad31-a1551d14a69d None None] MFA Rules not processed for user `f3e9ae13e7494191b27bbcc753aba037`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:37.892655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de49df1e-36c3-4575-ad31-a1551d14a69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:37.964778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:37.965935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fbfcc-2b06-4df9-9400-48d1b68fe982 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:37.980307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:37.981782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:37.982744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:37.983357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:37.987316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:37.995857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 997/2004] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:38.005295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca055d79-d8c6-4762-b511-34779c6c60b5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.005755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca055d79-d8c6-4762-b511-34779c6c60b5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.006194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca055d79-d8c6-4762-b511-34779c6c60b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.044735 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ca055d79-d8c6-4762-b511-34779c6c60b5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:38.046800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ca055d79-d8c6-4762-b511-34779c6c60b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:38.058936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 998/2005] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:38.061221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdaafa-ae41-43c1-95b1-4a4c23131633 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.061712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdaafa-ae41-43c1-95b1-4a4c23131633 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.062263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcdaafa-ae41-43c1-95b1-4a4c23131633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.100072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8bcdaafa-ae41-43c1-95b1-4a4c23131633 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:38.102741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8bcdaafa-ae41-43c1-95b1-4a4c23131633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:38.117884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 999/2006] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:38.120363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0f95-63d6-4009-9056-c6cbdf5ebbf3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.121711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0f95-63d6-4009-9056-c6cbdf5ebbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.121711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0f95-63d6-4009-9056-c6cbdf5ebbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.146838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.151163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.158586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a6eb0f95-63d6-4009-9056-c6cbdf5ebbf3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:38.161405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a6eb0f95-63d6-4009-9056-c6cbdf5ebbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:38.172487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1008/2007] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:38.174055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.190772 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1000/2008] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:38.196312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521a6ca-3213-4dc2-a1d6-85a5fc42bcfd service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.196810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb0f95-63d6-4009-9056-c6cbdf5ebbf3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.208863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.209579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.210099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.210508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb0f95-63d6-4009-9056-c6cbdf5ebbf3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.210618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.211507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:38.212009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.214798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.219937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.220587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.222248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.222631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.223517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:38.223855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.227395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.233795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1009/2009] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:38.238700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.245436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1001/2010] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:38.249514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.250338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad2f2d-8fa9-4a4a-8189-82390fc8f27f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.259225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083508a8-db32-4afc-a25e-a662115378e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.259959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083508a8-db32-4afc-a25e-a662115378e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.260246 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083508a8-db32-4afc-a25e-a662115378e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.260525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083508a8-db32-4afc-a25e-a662115378e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.261168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083508a8-db32-4afc-a25e-a662115378e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.263090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083508a8-db32-4afc-a25e-a662115378e2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.265022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a1869-04c8-4a21-add9-82f60156593b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.270851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff652-be01-4c33-8fbb-b102361618fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.271469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff652-be01-4c33-8fbb-b102361618fd admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.271790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff652-be01-4c33-8fbb-b102361618fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.272073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff652-be01-4c33-8fbb-b102361618fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.272793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ff652-be01-4c33-8fbb-b102361618fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.276388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ff652-be01-4c33-8fbb-b102361618fd admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.399809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1010/2011] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:38 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:38.401031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083508a8-db32-4afc-a25e-a662115378e2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.412416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:38.418816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1002/2012] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:38 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:38.420098 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff652-be01-4c33-8fbb-b102361618fd admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.498931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083508a8-db32-4afc-a25e-a662115378e2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.505668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff652-be01-4c33-8fbb-b102361618fd admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.510579 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2575a-411f-4cd0-ab68-4fae638eb615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.511233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2575a-411f-4cd0-ab68-4fae638eb615 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.511959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2575a-411f-4cd0-ab68-4fae638eb615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.512243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2575a-411f-4cd0-ab68-4fae638eb615 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.512884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2575a-411f-4cd0-ab68-4fae638eb615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.514805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2575a-411f-4cd0-ab68-4fae638eb615 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.550393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.550999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.551275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.551549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.553373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:38.628627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.630530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.640898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1011/2013] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:38.641947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.646322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1003/2014] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:38 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:38.650502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2575a-411f-4cd0-ab68-4fae638eb615 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.654884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff96a61e-4b32-4ba6-86dc-05a18f21f33f service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.660055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6fce3-6829-4196-98b5-cb6536c5d9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.660518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6fce3-6829-4196-98b5-cb6536c5d9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.660799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6fce3-6829-4196-98b5-cb6536c5d9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.661014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2575a-411f-4cd0-ab68-4fae638eb615 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.669793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6fce3-6829-4196-98b5-cb6536c5d9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.669793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6fce3-6829-4196-98b5-cb6536c5d9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.669793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6fce3-6829-4196-98b5-cb6536c5d9e2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.670629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665cfe1-0da7-4da3-9807-5bcfe48f1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.670629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cfe1-0da7-4da3-9807-5bcfe48f1ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.670629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cfe1-0da7-4da3-9807-5bcfe48f1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.670629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665cfe1-0da7-4da3-9807-5bcfe48f1ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.670913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665cfe1-0da7-4da3-9807-5bcfe48f1ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.670913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0665cfe1-0da7-4da3-9807-5bcfe48f1ec1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.683913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1004/2015] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:38.688581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665cfe1-0da7-4da3-9807-5bcfe48f1ec1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.701015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0665cfe1-0da7-4da3-9807-5bcfe48f1ec1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.707165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706da8b-a7ad-4ece-82b0-de7c78059859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.708577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706da8b-a7ad-4ece-82b0-de7c78059859 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.708686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706da8b-a7ad-4ece-82b0-de7c78059859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.708891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706da8b-a7ad-4ece-82b0-de7c78059859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.709570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706da8b-a7ad-4ece-82b0-de7c78059859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.711199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706da8b-a7ad-4ece-82b0-de7c78059859 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.731719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1005/2016] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:38.733654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706da8b-a7ad-4ece-82b0-de7c78059859 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.748345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706da8b-a7ad-4ece-82b0-de7c78059859 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.753417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.754139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.754422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.754700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] PATH_INFO: `/v3/projects/af51fa77ac47453e8e0f15be1c624a5e/users/d1c1052b8576447fb441cf1f7bf0c3f7/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.788670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af51fa77ac47453e8e0f15be1c624a5e, user_id=d1c1052b8576447fb441cf1f7bf0c3f7, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.796021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.801591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1012/2017] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:38 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:38.804960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6fce3-6829-4196-98b5-cb6536c5d9e2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.821443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6fce3-6829-4196-98b5-cb6536c5d9e2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.834216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e4f41-2e7f-4f6e-9f12-1892fcfd7181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.834216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4f41-2e7f-4f6e-9f12-1892fcfd7181 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.834216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4f41-2e7f-4f6e-9f12-1892fcfd7181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.834216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4f41-2e7f-4f6e-9f12-1892fcfd7181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.834595 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e4f41-2e7f-4f6e-9f12-1892fcfd7181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.835269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e4f41-2e7f-4f6e-9f12-1892fcfd7181 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.849956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1013/2018] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:38.852161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e4f41-2e7f-4f6e-9f12-1892fcfd7181 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.868400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e4f41-2e7f-4f6e-9f12-1892fcfd7181 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.874664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b32-19dd-47b1-86e1-4fd29b6ab2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.875581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b32-19dd-47b1-86e1-4fd29b6ab2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.876071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b32-19dd-47b1-86e1-4fd29b6ab2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.876749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c88b32-19dd-47b1-86e1-4fd29b6ab2a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.877573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c88b32-19dd-47b1-86e1-4fd29b6ab2a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:38.879560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c88b32-19dd-47b1-86e1-4fd29b6ab2a0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:38.892729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1014/2019] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:38.897863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b32-19dd-47b1-86e1-4fd29b6ab2a0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.908265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c88b32-19dd-47b1-86e1-4fd29b6ab2a0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.918408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1006/2020] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:38 2022] PUT /identity/v3/projects/af51fa77ac47453e8e0f15be1c624a5e/users/d1c1052b8576447fb441cf1f7bf0c3f7/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:38.919792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:38.922239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:38.982330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dde2c-a243-4dfb-94e7-7d9485fd2615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:38.983004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dde2c-a243-4dfb-94e7-7d9485fd2615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:38.983284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dde2c-a243-4dfb-94e7-7d9485fd2615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:38.983956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dde2c-a243-4dfb-94e7-7d9485fd2615 admin admin] PATH_INFO: `/v3/projects/e3cbe9f775e34ba3bf05429e9d2916f4/users/995ebc000bd446debd0d1a08080af5bf/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:38.998860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94ed44-f9da-47df-a37b-bbd526dddb10 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:38.999879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dde2c-a243-4dfb-94e7-7d9485fd2615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cbe9f775e34ba3bf05429e9d2916f4, user_id=995ebc000bd446debd0d1a08080af5bf, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:39.002618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19e779-eac2-404d-a276-0736c8b7f8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:39.002748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dde2c-a243-4dfb-94e7-7d9485fd2615 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:39.003417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19e779-eac2-404d-a276-0736c8b7f8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.003888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19e779-eac2-404d-a276-0736c8b7f8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.004178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19e779-eac2-404d-a276-0736c8b7f8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.005972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fb19e779-eac2-404d-a276-0736c8b7f8b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:39.079717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19e779-eac2-404d-a276-0736c8b7f8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:39.079717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19e779-eac2-404d-a276-0736c8b7f8b6 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:39.079717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1007/2021] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:39.079717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb984d0-f292-429d-ab80-2598595a201a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.079717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb984d0-f292-429d-ab80-2598595a201a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.079717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb984d0-f292-429d-ab80-2598595a201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.108781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-adb984d0-f292-429d-ab80-2598595a201a None None] MFA Rules not processed for user `d1c1052b8576447fb441cf1f7bf0c3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:39.109996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-adb984d0-f292-429d-ab80-2598595a201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:39.168545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1015/2022] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:38 2022] PUT /identity/v3/projects/e3cbe9f775e34ba3bf05429e9d2916f4/users/995ebc000bd446debd0d1a08080af5bf/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:39.170681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63054a9-532a-4070-b77b-7ba48fa3694c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.170978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63054a9-532a-4070-b77b-7ba48fa3694c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.171268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63054a9-532a-4070-b77b-7ba48fa3694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.184384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1008/2023] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:39.185663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21dc1-5cb1-49ef-ad1c-ed78ea29633d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.185952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21dc1-5cb1-49ef-ad1c-ed78ea29633d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.186228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d21dc1-5cb1-49ef-ad1c-ed78ea29633d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.197921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b63054a9-532a-4070-b77b-7ba48fa3694c None None] MFA Rules not processed for user `e1239200e38e499bb36153a0eb813c72`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:39.199023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b63054a9-532a-4070-b77b-7ba48fa3694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:39.223810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-40d21dc1-5cb1-49ef-ad1c-ed78ea29633d None None] MFA Rules not processed for user `995ebc000bd446debd0d1a08080af5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:39.225053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-40d21dc1-5cb1-49ef-ad1c-ed78ea29633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:39.259882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1016/2024] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:39.261068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63054a9-532a-4070-b77b-7ba48fa3694c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:39.309407 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1009/2025] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:39.329454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63054a9-532a-4070-b77b-7ba48fa3694c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:39.334947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9085f-0d10-4507-b2c2-b3a02fa4d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:39.335494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9085f-0d10-4507-b2c2-b3a02fa4d3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.335821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9085f-0d10-4507-b2c2-b3a02fa4d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.336106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9085f-0d10-4507-b2c2-b3a02fa4d3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.336819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9085f-0d10-4507-b2c2-b3a02fa4d3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:39.338751 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9085f-0d10-4507-b2c2-b3a02fa4d3c9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:39.423374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1017/2026] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:39 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:39.425580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d21dc1-5cb1-49ef-ad1c-ed78ea29633d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:39.436580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d21dc1-5cb1-49ef-ad1c-ed78ea29633d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:39.501638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db431f96-dd65-40cd-8926-1553485524fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:39.502307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db431f96-dd65-40cd-8926-1553485524fb admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.502731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db431f96-dd65-40cd-8926-1553485524fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.503142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db431f96-dd65-40cd-8926-1553485524fb admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.504011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db431f96-dd65-40cd-8926-1553485524fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:39.505987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db431f96-dd65-40cd-8926-1553485524fb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:39.599140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71255-ea29-40ad-9adf-4207d9393baa None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.599438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71255-ea29-40ad-9adf-4207d9393baa None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.599757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a71255-ea29-40ad-9adf-4207d9393baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-31a71255-ea29-40ad-9adf-4207d9393baa None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:18:39.606556 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:18:39.607472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:18:39.608657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1018/2027] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:18:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 19:18:39.674225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1010/2028] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:39 2022] POST /identity/v3/users => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:39.679103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71255-ea29-40ad-9adf-4207d9393baa None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:39.705581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a71255-ea29-40ad-9adf-4207d9393baa None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:39.712335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aa586-e679-4ea5-9166-e2f504a9d2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:39.713308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa586-e679-4ea5-9166-e2f504a9d2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.713793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa586-e679-4ea5-9166-e2f504a9d2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.714279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa586-e679-4ea5-9166-e2f504a9d2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.715412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aa586-e679-4ea5-9166-e2f504a9d2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:39.718389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aa586-e679-4ea5-9166-e2f504a9d2a7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:39.729953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1019/2029] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:39.734367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db431f96-dd65-40cd-8926-1553485524fb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:39.744785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db431f96-dd65-40cd-8926-1553485524fb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:39.749486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26cd0-6f87-431e-ad3d-60d1261d3016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:39.750149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26cd0-6f87-431e-ad3d-60d1261d3016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.750437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26cd0-6f87-431e-ad3d-60d1261d3016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.750718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e26cd0-6f87-431e-ad3d-60d1261d3016 admin admin] PATH_INFO: `/v3/projects/4323c56553eb47e192bb5d2305609b86/users/6bbf1f37ca99441c95af6ecc6e7476bb/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.766803 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e26cd0-6f87-431e-ad3d-60d1261d3016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4323c56553eb47e192bb5d2305609b86, user_id=6bbf1f37ca99441c95af6ecc6e7476bb, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:39.769791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e26cd0-6f87-431e-ad3d-60d1261d3016 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:39.792057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aa586-e679-4ea5-9166-e2f504a9d2a7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:39.850846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aa586-e679-4ea5-9166-e2f504a9d2a7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:39.854774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbdd45-5249-4ac0-a269-e0f993972b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:39.855396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbdd45-5249-4ac0-a269-e0f993972b39 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:39.855703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbdd45-5249-4ac0-a269-e0f993972b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:39.855986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbdd45-5249-4ac0-a269-e0f993972b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:39.899971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1011/2030] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:39 2022] PUT /identity/v3/projects/4323c56553eb47e192bb5d2305609b86/users/6bbf1f37ca99441c95af6ecc6e7476bb/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:39.900975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26cd0-6f87-431e-ad3d-60d1261d3016 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:39.936239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbdd45-5249-4ac0-a269-e0f993972b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:39.937757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbdd45-5249-4ac0-a269-e0f993972b39 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:39.952001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1020/2031] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:40.011625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e26cd0-6f87-431e-ad3d-60d1261d3016 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:40.024488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e3242-dae2-4ec0-aaea-7203f2d7afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:40.024809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3242-dae2-4ec0-aaea-7203f2d7afdb admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:40.025083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3242-dae2-4ec0-aaea-7203f2d7afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:40.025539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3242-dae2-4ec0-aaea-7203f2d7afdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:40.027397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e3242-dae2-4ec0-aaea-7203f2d7afdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:40.029502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e3242-dae2-4ec0-aaea-7203f2d7afdb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:40.044253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1012/2032] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:40.048393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbdd45-5249-4ac0-a269-e0f993972b39 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:40.075173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbdd45-5249-4ac0-a269-e0f993972b39 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:40.088080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b0db-29a4-4e4d-a69c-2303342e9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:40.089101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b0db-29a4-4e4d-a69c-2303342e9913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:40.089492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b0db-29a4-4e4d-a69c-2303342e9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:40.089937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7b0db-29a4-4e4d-a69c-2303342e9913 admin admin] PATH_INFO: `/v3/projects/4323c56553eb47e192bb5d2305609b86/users/6bbf1f37ca99441c95af6ecc6e7476bb/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:40.107866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7b0db-29a4-4e4d-a69c-2303342e9913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4323c56553eb47e192bb5d2305609b86, user_id=6bbf1f37ca99441c95af6ecc6e7476bb, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:40.107866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7b0db-29a4-4e4d-a69c-2303342e9913 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:40.134039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1021/2033] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:40 2022] PUT /identity/v3/projects/4323c56553eb47e192bb5d2305609b86/users/6bbf1f37ca99441c95af6ecc6e7476bb/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:40.157529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba6ef-695b-45df-b261-12d9d556f196 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:40.157859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba6ef-695b-45df-b261-12d9d556f196 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:40.158136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ba6ef-695b-45df-b261-12d9d556f196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:40.170974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:40.193791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d19ba6ef-695b-45df-b261-12d9d556f196 None None] MFA Rules not processed for user `6bbf1f37ca99441c95af6ecc6e7476bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:40.195011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d19ba6ef-695b-45df-b261-12d9d556f196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:40.288661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1013/2034] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:40.599212 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b0db-29a4-4e4d-a69c-2303342e9913 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:40.669155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7b0db-29a4-4e4d-a69c-2303342e9913 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:40.672651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:40.673290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:40.673577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:40.673847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:40.683794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:40.685800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:40.696984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1022/2035] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:40.914575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ba6ef-695b-45df-b261-12d9d556f196 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:40.924963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ba6ef-695b-45df-b261-12d9d556f196 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:40.926148 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:40.930007 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63a712-7544-4381-bb8d-b189fd453569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:40.931880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63a712-7544-4381-bb8d-b189fd453569 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:40.932382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63a712-7544-4381-bb8d-b189fd453569 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:40.934258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63a712-7544-4381-bb8d-b189fd453569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:40.999933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63a712-7544-4381-bb8d-b189fd453569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:41.001667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63a712-7544-4381-bb8d-b189fd453569 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:41.012291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1014/2036] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:18:41.506647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:41.508330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:41.584200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0258e2-d11b-4a0e-87af-bf2423e95c01 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:41.590672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:41.591493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:41.591931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:41.592224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] PATH_INFO: `/v3/users/fb1ae95760a84778861e52e0fa3e52c3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:41.593762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb1ae95760a84778861e52e0fa3e52c3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:41.595658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:42.006071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb1ae95760a84778861e52e0fa3e52c3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:42.068375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb1ae95760a84778861e52e0fa3e52c3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:42.069109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb1ae95760a84778861e52e0fa3e52c3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:42.107130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb1ae95760a84778861e52e0fa3e52c3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:42.107942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb1ae95760a84778861e52e0fa3e52c3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:42.125494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1023/2037] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:41 2022] DELETE /identity/v3/users/fb1ae95760a84778861e52e0fa3e52c3 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:42.130504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b386f9-24e4-497d-ba43-99717e684d49 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:42.131013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b386f9-24e4-497d-ba43-99717e684d49 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:42.131089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b386f9-24e4-497d-ba43-99717e684d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:42.166919 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-57b386f9-24e4-497d-ba43-99717e684d49 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:42.168470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-57b386f9-24e4-497d-ba43-99717e684d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:42.292386 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1015/2038] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:42.304055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:42.306483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:42.390514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83784e7-9993-417f-896e-35a099842a09 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:42.395900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25580aeb-d24b-4df8-96c9-8357a6424602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:42.396535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25580aeb-d24b-4df8-96c9-8357a6424602 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:42.396817 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25580aeb-d24b-4df8-96c9-8357a6424602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:42.397144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25580aeb-d24b-4df8-96c9-8357a6424602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:42.407299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25580aeb-d24b-4df8-96c9-8357a6424602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:42.408875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25580aeb-d24b-4df8-96c9-8357a6424602 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:42.423872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1024/2039] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:42.945057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:43.031541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b386f9-24e4-497d-ba43-99717e684d49 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:43.035328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-57b386f9-24e4-497d-ba43-99717e684d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:43.062984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b386f9-24e4-497d-ba43-99717e684d49 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:43.062984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:43.062984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:43.062984 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:43.063325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] PATH_INFO: `/v3/projects/31e7647e8c034063ba242a624e9fcb37` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:43.064192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e7647e8c034063ba242a624e9fcb37)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:43.067028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:43.365451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e7647e8c034063ba242a624e9fcb37', 'request_id': 'req-114524cd-abee-4725-957a-358c9d3a5990'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:43.438510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ee73-d79b-45f8-9dc2-39af0e68a2b0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:43.439005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ee73-d79b-45f8-9dc2-39af0e68a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:43.439140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ee73-d79b-45f8-9dc2-39af0e68a2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:43.474817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e7647e8c034063ba242a624e9fcb37', 'request_id': 'req-114524cd-abee-4725-957a-358c9d3a5990'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:43.479498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-64f9ee73-d79b-45f8-9dc2-39af0e68a2b0 None None] MFA Rules not processed for user `995ebc000bd446debd0d1a08080af5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:43.480786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-64f9ee73-d79b-45f8-9dc2-39af0e68a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:43.499451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e7647e8c034063ba242a624e9fcb37', 'request_id': 'req-114524cd-abee-4725-957a-358c9d3a5990'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:43.526075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] The token cache is being invalidate because project 31e7647e8c034063ba242a624e9fcb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:43.526480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:43.528475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-114524cd-abee-4725-957a-358c9d3a5990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:43.535082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1016/2040] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:43 2022] DELETE /identity/v3/projects/31e7647e8c034063ba242a624e9fcb37 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:43.536671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb11fe-ee66-4597-827a-3936d86a007f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:43.536834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb11fe-ee66-4597-827a-3936d86a007f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:43.537151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb11fe-ee66-4597-827a-3936d86a007f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:43.570499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1feb11fe-ee66-4597-827a-3936d86a007f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:43.572361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1feb11fe-ee66-4597-827a-3936d86a007f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:43.611868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1025/2041] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:43.660393 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1017/2042] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:43.673922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe107-0131-499b-9a82-85b171081239 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:43.678736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe107-0131-499b-9a82-85b171081239 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:43.678736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00abe107-0131-499b-9a82-85b171081239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:43.699163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:43.707391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-00abe107-0131-499b-9a82-85b171081239 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:43.707391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-00abe107-0131-499b-9a82-85b171081239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:43.715769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1026/2043] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:43.720470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb11fe-ee66-4597-827a-3936d86a007f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:43.730782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb11fe-ee66-4597-827a-3936d86a007f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:43.735622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:43.736469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:43.736807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:43.737167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:43.737829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:43.738484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:43.740116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:43.752170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1018/2044] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:43.757870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe107-0131-499b-9a82-85b171081239 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:43.768069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00abe107-0131-499b-9a82-85b171081239 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:43.774447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eecd5-9b81-4187-8b93-59d9fbcb7c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:43.775167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eecd5-9b81-4187-8b93-59d9fbcb7c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:43.775555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eecd5-9b81-4187-8b93-59d9fbcb7c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:43.775925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eecd5-9b81-4187-8b93-59d9fbcb7c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:43.776649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eecd5-9b81-4187-8b93-59d9fbcb7c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:43.778624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eecd5-9b81-4187-8b93-59d9fbcb7c8e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:43.896015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:43.898784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1027/2045] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:43 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:18:43.911387 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87a7a4-5512-4d39-b568-7de3d4339830 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:44.022044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690d7ac-25c1-478f-ad5d-c685eebe016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:44.022044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d7ac-25c1-478f-ad5d-c685eebe016d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:44.022044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d7ac-25c1-478f-ad5d-c685eebe016d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:44.022044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690d7ac-25c1-478f-ad5d-c685eebe016d admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:44.022767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690d7ac-25c1-478f-ad5d-c685eebe016d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:44.033061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690d7ac-25c1-478f-ad5d-c685eebe016d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:44.144181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1019/2046] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:43 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:44.148610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eecd5-9b81-4187-8b93-59d9fbcb7c8e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:44.161519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eecd5-9b81-4187-8b93-59d9fbcb7c8e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:44.175523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:44.184887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:44.185135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:44.185423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:44.186153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:44.189616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:44.203392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1028/2047] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:44.211050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690d7ac-25c1-478f-ad5d-c685eebe016d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:44.235819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690d7ac-25c1-478f-ad5d-c685eebe016d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:44.244760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:44.245448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd08d7-2c7b-410d-b25a-3827506b7562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:44.246079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd08d7-2c7b-410d-b25a-3827506b7562 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:44.246370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd08d7-2c7b-410d-b25a-3827506b7562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:44.246653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd08d7-2c7b-410d-b25a-3827506b7562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:44.247247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:44.247364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd08d7-2c7b-410d-b25a-3827506b7562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:44.248922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd08d7-2c7b-410d-b25a-3827506b7562 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:44.286492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1020/2048] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:44.291489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd08d7-2c7b-410d-b25a-3827506b7562 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:44.339479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd08d7-2c7b-410d-b25a-3827506b7562 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:44.348862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97212-0964-4248-9d56-afaf5dc2eaf8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:44.354278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:44.355170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab897e-4e81-4e03-abed-4fd2a3db7839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:44.355320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:44.355826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:44.356163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab897e-4e81-4e03-abed-4fd2a3db7839 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:44.356406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:44.356635 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab897e-4e81-4e03-abed-4fd2a3db7839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:44.357013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab897e-4e81-4e03-abed-4fd2a3db7839 admin admin] PATH_INFO: `/v3/projects/b5f31208cb5a46719798f1a37df1549f/users/8d53a7f6623947878317c176e1a202c0/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:44.359221 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:44.390190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab897e-4e81-4e03-abed-4fd2a3db7839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f31208cb5a46719798f1a37df1549f, user_id=8d53a7f6623947878317c176e1a202c0, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:44.393218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab897e-4e81-4e03-abed-4fd2a3db7839 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:44.495476 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:44.497687 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:44.514792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1029/2049] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:44.515973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:44.518645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:44.551977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1021/2050] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:44 2022] PUT /identity/v3/projects/b5f31208cb5a46719798f1a37df1549f/users/8d53a7f6623947878317c176e1a202c0/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:44.562575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20103-364f-43b6-8ab5-c07a15c366ed None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:44.563150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20103-364f-43b6-8ab5-c07a15c366ed None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:44.564005 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d20103-364f-43b6-8ab5-c07a15c366ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:44.614970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-28d20103-364f-43b6-8ab5-c07a15c366ed None None] MFA Rules not processed for user `8d53a7f6623947878317c176e1a202c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:44.617874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-28d20103-364f-43b6-8ab5-c07a15c366ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:44.640254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4bcee-3a92-4e00-9269-f7f184a67ed3 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:44.710869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1022/2051] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:44.715669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20103-364f-43b6-8ab5-c07a15c366ed None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:44.718191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf58a62bd2e4139965fc25a4f9c6161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:44.718852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:44.719308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:44.719509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:44.721517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:44.741186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:44.743336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:44.764236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:44.767274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1030/2052] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:44.890025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d20103-364f-43b6-8ab5-c07a15c366ed None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:44.924378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:44.925599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:44.926050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:44.926340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:44.926997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:44.935352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:45.068335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1023/2053] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:44 2022] POST /identity/v3/projects => generated 379 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:45.073733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:45.091259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab0da1-08eb-410e-86ca-d389318989a6 service placement] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:45.251248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e67fb-7484-4a63-a905-94fa61349830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:45.251986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e67fb-7484-4a63-a905-94fa61349830 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:45.252273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e67fb-7484-4a63-a905-94fa61349830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:45.252553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e67fb-7484-4a63-a905-94fa61349830 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:45.254229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e67fb-7484-4a63-a905-94fa61349830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:45.256375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e67fb-7484-4a63-a905-94fa61349830 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:45.389593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:45.391462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:45.412307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1031/2054] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:45 2022] POST /identity/v3/users => generated 296 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:45.414133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84118a02-c0fa-4f2a-b481-abcacaa9c3c8 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:45.416586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e67fb-7484-4a63-a905-94fa61349830 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:45.435624 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:45.436328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:45.436617 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:45.438264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] PATH_INFO: `/v3/users/43fac1d9797b4639b3bd843866fa2912` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:45.438434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43fac1d9797b4639b3bd843866fa2912)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:45.440706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:45.450676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e67fb-7484-4a63-a905-94fa61349830 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:45.459201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be050d7-81c7-42bc-8d7d-12e6ca4effde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:45.468519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be050d7-81c7-42bc-8d7d-12e6ca4effde admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:45.469343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be050d7-81c7-42bc-8d7d-12e6ca4effde admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:45.470005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be050d7-81c7-42bc-8d7d-12e6ca4effde admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:45.478079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be050d7-81c7-42bc-8d7d-12e6ca4effde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:45.478079 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be050d7-81c7-42bc-8d7d-12e6ca4effde admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:45.493094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1032/2055] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:45.497601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be050d7-81c7-42bc-8d7d-12e6ca4effde admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:45.521802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be050d7-81c7-42bc-8d7d-12e6ca4effde admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:45.533814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9846581-c848-4a4d-9326-157ac9d0fbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:45.535142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9846581-c848-4a4d-9326-157ac9d0fbea admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:45.535699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9846581-c848-4a4d-9326-157ac9d0fbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:45.536138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9846581-c848-4a4d-9326-157ac9d0fbea admin admin] PATH_INFO: `/v3/projects/27493af24348426cafbe338fa993e3e0/users/bd9ea292a6d44babacb5d6b971c0ee65/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:45.555641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9846581-c848-4a4d-9326-157ac9d0fbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=27493af24348426cafbe338fa993e3e0, user_id=bd9ea292a6d44babacb5d6b971c0ee65, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:45.558593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9846581-c848-4a4d-9326-157ac9d0fbea admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:45.728823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1033/2056] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:45 2022] PUT /identity/v3/projects/27493af24348426cafbe338fa993e3e0/users/bd9ea292a6d44babacb5d6b971c0ee65/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:45.745682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9846581-c848-4a4d-9326-157ac9d0fbea admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:45.805482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43fac1d9797b4639b3bd843866fa2912'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:45.806705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43fac1d9797b4639b3bd843866fa2912'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:45.861915 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9846581-c848-4a4d-9326-157ac9d0fbea admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:45.868054 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52fdaa-1005-49bd-a287-16d9f85f23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:45.868944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52fdaa-1005-49bd-a287-16d9f85f23c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:45.869440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52fdaa-1005-49bd-a287-16d9f85f23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:45.870035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52fdaa-1005-49bd-a287-16d9f85f23c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:45.871153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52fdaa-1005-49bd-a287-16d9f85f23c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:45.873146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52fdaa-1005-49bd-a287-16d9f85f23c9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:45.875977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43fac1d9797b4639b3bd843866fa2912'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:45.876810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43fac1d9797b4639b3bd843866fa2912'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:45.886202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1034/2057] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:45.887864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bcd7-2bb9-4213-8884-296b92a39124 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:45.888299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bcd7-2bb9-4213-8884-296b92a39124 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:45.888574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bcd7-2bb9-4213-8884-296b92a39124 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:45.889942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1035/2058] 10.222.0.82 () {54 vars in 921 bytes} [Mon Aug 29 19:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:45.890969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602bcd7-2bb9-4213-8884-296b92a39124 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:45.892912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6602bcd7-2bb9-4213-8884-296b92a39124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:45.894469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0170abc6-133b-4cd5-8bdd-b33cacbffac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43fac1d9797b4639b3bd843866fa2912'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:45.910423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1024/2059] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:45 2022] DELETE /identity/v3/users/43fac1d9797b4639b3bd843866fa2912 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:45.913622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602bcd7-2bb9-4213-8884-296b92a39124 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:45.913825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dc550-1f7f-426f-b545-727027673558 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:45.913825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dc550-1f7f-426f-b545-727027673558 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:45.914023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dc550-1f7f-426f-b545-727027673558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:45.937454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e59dc550-1f7f-426f-b545-727027673558 None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:45.938700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e59dc550-1f7f-426f-b545-727027673558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:45.969821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:45.985710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64d0e7-05c5-4469-9d85-ca3cb5a0afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:45.986376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d0e7-05c5-4469-9d85-ca3cb5a0afa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:45.986657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d0e7-05c5-4469-9d85-ca3cb5a0afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:45.986938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64d0e7-05c5-4469-9d85-ca3cb5a0afa7 admin admin] PATH_INFO: `/v3/projects/27493af24348426cafbe338fa993e3e0/users/bd9ea292a6d44babacb5d6b971c0ee65/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:45.989835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64d0e7-05c5-4469-9d85-ca3cb5a0afa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27493af24348426cafbe338fa993e3e0, user_id=bd9ea292a6d44babacb5d6b971c0ee65, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:45.992871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64d0e7-05c5-4469-9d85-ca3cb5a0afa7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:46.003486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1036/2060] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:45 2022] PUT /identity/v3/projects/27493af24348426cafbe338fa993e3e0/users/bd9ea292a6d44babacb5d6b971c0ee65/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:46.004792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524364c6-b2e0-40bb-9072-d500bfb0576a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:46.005085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524364c6-b2e0-40bb-9072-d500bfb0576a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:46.005364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524364c6-b2e0-40bb-9072-d500bfb0576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:46.018929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1025/2061] 10.222.0.82 () {58 vars in 1018 bytes} [Mon Aug 29 19:18:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:46.021062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c14ac-1623-4ed8-82b7-64a73624a7af None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:46.026956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c14ac-1623-4ed8-82b7-64a73624a7af None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:46.026956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c14ac-1623-4ed8-82b7-64a73624a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:46.027366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-524364c6-b2e0-40bb-9072-d500bfb0576a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:46.027366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-524364c6-b2e0-40bb-9072-d500bfb0576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:46.051044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:46.071445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6d7c14ac-1623-4ed8-82b7-64a73624a7af None None] MFA Rules not processed for user `bd9ea292a6d44babacb5d6b971c0ee65`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:46.071445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6d7c14ac-1623-4ed8-82b7-64a73624a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:46.133009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1037/2062] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:46.134738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f566e-2255-4c22-8406-771b9c4b862c None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:46.135109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f566e-2255-4c22-8406-771b9c4b862c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:46.135422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f566e-2255-4c22-8406-771b9c4b862c None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:46.137150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1038/2063] 10.222.0.82 () {54 vars in 961 bytes} [Mon Aug 29 19:18:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:46.138609 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f566e-2255-4c22-8406-771b9c4b862c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:46.141672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c55f566e-2255-4c22-8406-771b9c4b862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:46.183774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f566e-2255-4c22-8406-771b9c4b862c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:46.188146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1026/2064] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:46.189980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3412a-4d4f-4db6-962d-e9520246ea79 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:46.191591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3412a-4d4f-4db6-962d-e9520246ea79 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:46.191591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3412a-4d4f-4db6-962d-e9520246ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:46.195369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:46.196182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:46.196568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:46.196950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] PATH_INFO: `/v3/users/e1239200e38e499bb36153a0eb813c72` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:46.198346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1239200e38e499bb36153a0eb813c72)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:46.207788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:46.215938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fff3412a-4d4f-4db6-962d-e9520246ea79 None None] MFA Rules not processed for user `abf58a62bd2e4139965fc25a4f9c6161`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:46.217905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fff3412a-4d4f-4db6-962d-e9520246ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:46.304643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1027/2065] 10.222.0.82 () {58 vars in 1058 bytes} [Mon Aug 29 19:18:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:46.306147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3412a-4d4f-4db6-962d-e9520246ea79 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:46.307622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fff3412a-4d4f-4db6-962d-e9520246ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:46.367455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3412a-4d4f-4db6-962d-e9520246ea79 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:46.371842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:46.372518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:46.372802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:46.373074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:46.384532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:46.385806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:46.398802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1028/2066] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:46.399683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:46.401132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:46.455719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1239200e38e499bb36153a0eb813c72'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:46.466181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22c379-38cc-441c-ab72-f91ebdae2582 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:46.470130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:46.470785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:46.471071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:46.471350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:46.473855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:46.538777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:46.540217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:46.549663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1029/2067] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:46.550478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:46.561666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e11eb-bb19-4334-8ed1-45cbfba3297d service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:46.567192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7594b09-418e-4bdf-b8d8-bf64ce0ae895 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf58a62bd2e4139965fc25a4f9c6161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:46.567864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594b09-418e-4bdf-b8d8-bf64ce0ae895 service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:46.568143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594b09-418e-4bdf-b8d8-bf64ce0ae895 service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:46.568414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7594b09-418e-4bdf-b8d8-bf64ce0ae895 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:46.569188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1239200e38e499bb36153a0eb813c72'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:46.571204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1239200e38e499bb36153a0eb813c72'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:46.580721 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7594b09-418e-4bdf-b8d8-bf64ce0ae895 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:46.583239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7594b09-418e-4bdf-b8d8-bf64ce0ae895 service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:46.598768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1239200e38e499bb36153a0eb813c72'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:46.599549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1239200e38e499bb36153a0eb813c72'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:46.614291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1030/2068] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:46.616392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1039/2069] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:46 2022] DELETE /identity/v3/users/e1239200e38e499bb36153a0eb813c72 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:47.061058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7594b09-418e-4bdf-b8d8-bf64ce0ae895 service placement] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:47.067864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:47.069665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:47.082944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7594b09-418e-4bdf-b8d8-bf64ce0ae895 service placement] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:47.193135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0633c357-481d-4a40-ac22-1c1ad367c2c0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:47.198600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:47.199509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:47.199846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:47.200131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] PATH_INFO: `/v3/projects/e59f22f6f2c342e8a3b1156e33d811c5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:47.208825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59f22f6f2c342e8a3b1156e33d811c5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:47.210118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:47.220401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:47.221580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:47.222010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:47.222382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] PATH_INFO: `/v3/projects/b7d661c66522410a905a4609ff156273` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:47.223895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d661c66522410a905a4609ff156273)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:47.232468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:47.320822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:47.369436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d661c66522410a905a4609ff156273', 'request_id': 'req-4a1a476a-05f3-4b62-bc8a-291ee0c44653'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.390350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59f22f6f2c342e8a3b1156e33d811c5', 'request_id': 'req-df538252-ba1e-41f7-806b-c25810fc8380'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.485513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d661c66522410a905a4609ff156273', 'request_id': 'req-4a1a476a-05f3-4b62-bc8a-291ee0c44653'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.500931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d661c66522410a905a4609ff156273', 'request_id': 'req-4a1a476a-05f3-4b62-bc8a-291ee0c44653'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.514392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] The token cache is being invalidate because project b7d661c66522410a905a4609ff156273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:47.514696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.515429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4a1a476a-05f3-4b62-bc8a-291ee0c44653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.517263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1031/2070] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:47 2022] DELETE /identity/v3/projects/b7d661c66522410a905a4609ff156273 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:47.522448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812bf6-104d-4ef5-80cc-8d239b60d42d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:47.522757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812bf6-104d-4ef5-80cc-8d239b60d42d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:47.523014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8812bf6-104d-4ef5-80cc-8d239b60d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:47.544021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a8812bf6-104d-4ef5-80cc-8d239b60d42d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:47.545494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a8812bf6-104d-4ef5-80cc-8d239b60d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:47.620493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1032/2071] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:47.628766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde63a-1797-48c6-a6a3-fe4a0632d2f9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:47.629087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde63a-1797-48c6-a6a3-fe4a0632d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:47.629396 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcde63a-1797-48c6-a6a3-fe4a0632d2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:47.630834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59f22f6f2c342e8a3b1156e33d811c5', 'request_id': 'req-df538252-ba1e-41f7-806b-c25810fc8380'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.642724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59f22f6f2c342e8a3b1156e33d811c5', 'request_id': 'req-df538252-ba1e-41f7-806b-c25810fc8380'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.651860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7dcde63a-1797-48c6-a6a3-fe4a0632d2f9 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:47.653080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7dcde63a-1797-48c6-a6a3-fe4a0632d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:47.656253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] The token cache is being invalidate because project e59f22f6f2c342e8a3b1156e33d811c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:47.656832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.657555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:47.659284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1040/2072] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:47 2022] DELETE /identity/v3/projects/e59f22f6f2c342e8a3b1156e33d811c5 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:47.661610 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1033/2073] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:47.663283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:47.664999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:47.665629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde63a-1797-48c6-a6a3-fe4a0632d2f9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:47.674752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcde63a-1797-48c6-a6a3-fe4a0632d2f9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:47.679453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:47.680092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:47.680373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:47.680645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:47.681294 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:47.681598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:47.683173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:47.695228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1034/2074] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:18:47.699545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:47.703176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:47.731161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9fd11-300f-4f91-b36d-1e7d7d8df57b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:47.737153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6149-3280-4d7b-95aa-25e6bc0a59c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:47.737153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6149-3280-4d7b-95aa-25e6bc0a59c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:47.738130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6149-3280-4d7b-95aa-25e6bc0a59c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:47.738428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb6149-3280-4d7b-95aa-25e6bc0a59c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:47.739061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb6149-3280-4d7b-95aa-25e6bc0a59c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:47.740980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb6149-3280-4d7b-95aa-25e6bc0a59c6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:47.741970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df538252-ba1e-41f7-806b-c25810fc8380 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:47.748431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:47.748431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:47.748431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:47.748431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] PATH_INFO: `/v3/users/ea7269c3c8ec4020b6bb4a3075738bd1` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:47.749233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7269c3c8ec4020b6bb4a3075738bd1)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:47.751226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:47.949575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1035/2075] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:47 2022] POST /identity/v3/projects => generated 405 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:47.952900 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6149-3280-4d7b-95aa-25e6bc0a59c6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:48.024423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7269c3c8ec4020b6bb4a3075738bd1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.071218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb6149-3280-4d7b-95aa-25e6bc0a59c6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:48.081058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:48.082013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:48.082353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:48.082688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:48.083437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:48.086894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:48.207838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7269c3c8ec4020b6bb4a3075738bd1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.209465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7269c3c8ec4020b6bb4a3075738bd1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.215899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1036/2076] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:47 2022] POST /identity/v3/users => generated 303 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:48.216762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:48.220377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:48.228680 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7269c3c8ec4020b6bb4a3075738bd1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.229611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7269c3c8ec4020b6bb4a3075738bd1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.236896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d56f4-26d0-4b26-9be6-6405bd1cc4ca admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:48.244471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:48.245219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:48.245505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:48.245792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] PATH_INFO: `/v3/users/d1c1052b8576447fb441cf1f7bf0c3f7` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:48.254905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c1052b8576447fb441cf1f7bf0c3f7)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:48.257885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1041/2077] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:47 2022] DELETE /identity/v3/users/ea7269c3c8ec4020b6bb4a3075738bd1 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:48.258150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:48.258259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:48.258259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:48.376886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcc2bd-793b-4872-991b-9be504c65188 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:48.382318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:48.382927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:48.383206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:48.383477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:48.384156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:48.385932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:48.396929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1042/2078] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:48.397789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:48.399483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:48.412512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3e95e-fe9c-47be-80ae-84f5336e89b8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:48.417078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:48.417675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:48.417956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:48.418228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] PATH_INFO: `/v3/users/934908057b4e44b59d279e2617082fc6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:48.419330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934908057b4e44b59d279e2617082fc6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:48.421555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:48.599502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c1052b8576447fb441cf1f7bf0c3f7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.600234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c1052b8576447fb441cf1f7bf0c3f7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.692800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c1052b8576447fb441cf1f7bf0c3f7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.693577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c1052b8576447fb441cf1f7bf0c3f7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.707712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c1052b8576447fb441cf1f7bf0c3f7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.708274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934908057b4e44b59d279e2617082fc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.720192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1037/2079] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:48 2022] DELETE /identity/v3/users/d1c1052b8576447fb441cf1f7bf0c3f7 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:48.721028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:48.723152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:48.788969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aaa234-09b9-4b90-8d66-7544a0a7dadd admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:48.793618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:48.794226 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:48.794555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:48.794858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:48.795488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:48.797156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:48.809424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1038/2080] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:48.809424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:48.810900 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:48.847697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934908057b4e44b59d279e2617082fc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.849263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934908057b4e44b59d279e2617082fc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.896787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934908057b4e44b59d279e2617082fc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.897575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c1cdd67a-00fb-4842-9224-1670c1d58d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934908057b4e44b59d279e2617082fc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:48.899086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79a238-743c-4d7c-9b78-6576655328ab admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:48.905599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:48.906627 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:48.907153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:48.907671 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:48.910812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:48.922723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1043/2081] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:48 2022] DELETE /identity/v3/users/934908057b4e44b59d279e2617082fc6 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:48.926698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42cb6-671d-4f03-94f5-02e1f8308679 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:48.927437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42cb6-671d-4f03-94f5-02e1f8308679 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:48.928214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d42cb6-671d-4f03-94f5-02e1f8308679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:48.963169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-10d42cb6-671d-4f03-94f5-02e1f8308679 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:48.964638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-10d42cb6-671d-4f03-94f5-02e1f8308679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:48.999350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:48.999350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:49.009070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1039/2082] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:49.016840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:49.020868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.036474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b5215-271e-4e99-9616-0fe819fad1f3 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:49.062390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1044/2083] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:49.062390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d42cb6-671d-4f03-94f5-02e1f8308679 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:49.062653 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-10d42cb6-671d-4f03-94f5-02e1f8308679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.089161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d42cb6-671d-4f03-94f5-02e1f8308679 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:49.094278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:49.094911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.095203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.095626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] PATH_INFO: `/v3/projects/7c6cb99b6c8d4bfe9356a59cef2e56d2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.097362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6cb99b6c8d4bfe9356a59cef2e56d2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:49.099549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:49.100865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ade7-5d95-4352-97cb-62b648235015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:49.102004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ade7-5d95-4352-97cb-62b648235015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.102479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ade7-5d95-4352-97cb-62b648235015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.102829 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ade7-5d95-4352-97cb-62b648235015 admin admin] PATH_INFO: `/v3/projects/32cd904df814490093f2dd3c20b2bf9c/users/276a222a300c4f70a27dbefdd3a64324/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.119147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ade7-5d95-4352-97cb-62b648235015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32cd904df814490093f2dd3c20b2bf9c, user_id=276a222a300c4f70a27dbefdd3a64324, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:49.121886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ade7-5d95-4352-97cb-62b648235015 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:49.222100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1040/2084] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:49 2022] PUT /identity/v3/projects/32cd904df814490093f2dd3c20b2bf9c/users/276a222a300c4f70a27dbefdd3a64324/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:49.222659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84019ab0-bdc1-4c9e-906a-d03b11d41733 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.222946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84019ab0-bdc1-4c9e-906a-d03b11d41733 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.223229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84019ab0-bdc1-4c9e-906a-d03b11d41733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.241788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6cb99b6c8d4bfe9356a59cef2e56d2', 'request_id': 'req-dd691c8e-2afe-482c-9b8c-637ea5dd3070'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:49.263415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-84019ab0-bdc1-4c9e-906a-d03b11d41733 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:49.264951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-84019ab0-bdc1-4c9e-906a-d03b11d41733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.327983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:49.329615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6cb99b6c8d4bfe9356a59cef2e56d2', 'request_id': 'req-dd691c8e-2afe-482c-9b8c-637ea5dd3070'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:49.337935 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1041/2085] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:49.341244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6cb99b6c8d4bfe9356a59cef2e56d2', 'request_id': 'req-dd691c8e-2afe-482c-9b8c-637ea5dd3070'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:49.341353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84019ab0-bdc1-4c9e-906a-d03b11d41733 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:49.341580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-84019ab0-bdc1-4c9e-906a-d03b11d41733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.355970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] The token cache is being invalidate because project 7c6cb99b6c8d4bfe9356a59cef2e56d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:49.356260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:49.357029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd691c8e-2afe-482c-9b8c-637ea5dd3070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:49.358697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1045/2086] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:49 2022] DELETE /identity/v3/projects/7c6cb99b6c8d4bfe9356a59cef2e56d2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:49.359983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439bb8d-9283-4c8b-84b8-92714e21faa4 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.360267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439bb8d-9283-4c8b-84b8-92714e21faa4 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.360537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439bb8d-9283-4c8b-84b8-92714e21faa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.380451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1439bb8d-9283-4c8b-84b8-92714e21faa4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:49.381898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1439bb8d-9283-4c8b-84b8-92714e21faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.390576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1046/2087] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:49.392329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439bb8d-9283-4c8b-84b8-92714e21faa4 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:49.394010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1439bb8d-9283-4c8b-84b8-92714e21faa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.408629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84019ab0-bdc1-4c9e-906a-d03b11d41733 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:49.414080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439bb8d-9283-4c8b-84b8-92714e21faa4 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:49.414326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:49.415093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.415224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.415507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.418542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:49.421049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.421049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.421049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.422697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.426670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.439216 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:49.441347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:49.442374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:49.446287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:49.457083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1047/2088] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:49.458018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:49.458903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1042/2089] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:49.459798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:49.460045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.470110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337476f0-c0ef-4925-aff8-107a4ea49d6e service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:49.474127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d085c7-fe3d-4ff9-82b3-dde9e88101c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:49.474738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d085c7-fe3d-4ff9-82b3-dde9e88101c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.475279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d085c7-fe3d-4ff9-82b3-dde9e88101c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.475997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d085c7-fe3d-4ff9-82b3-dde9e88101c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.477721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7a99-b526-4804-b682-027357ac618b service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:49.485440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:49.486746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.487757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.492381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] PATH_INFO: `/v3/users/14737ab763234447b5bc4b0d98ab1208` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.492381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14737ab763234447b5bc4b0d98ab1208)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:49.492713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d085c7-fe3d-4ff9-82b3-dde9e88101c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:49.492713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d085c7-fe3d-4ff9-82b3-dde9e88101c5 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:49.492877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:49.509038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1043/2090] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:49.652762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88bb85-b28b-4681-bfef-49abd045a263 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:49.654355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88bb85-b28b-4681-bfef-49abd045a263 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:49.654355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88bb85-b28b-4681-bfef-49abd045a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:49.705283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-aa88bb85-b28b-4681-bfef-49abd045a263 None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:49.706705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aa88bb85-b28b-4681-bfef-49abd045a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:49.772939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1044/2091] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:18:49.886961 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14737ab763234447b5bc4b0d98ab1208'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:50.023351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14737ab763234447b5bc4b0d98ab1208'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:50.024723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14737ab763234447b5bc4b0d98ab1208'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:50.072663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14737ab763234447b5bc4b0d98ab1208'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:50.073913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14737ab763234447b5bc4b0d98ab1208'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:50.104963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1048/2092] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:49 2022] DELETE /identity/v3/users/14737ab763234447b5bc4b0d98ab1208 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:50.329338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88bb85-b28b-4681-bfef-49abd045a263 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:50.331552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aa88bb85-b28b-4681-bfef-49abd045a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:50.452499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88bb85-b28b-4681-bfef-49abd045a263 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:50.527174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:50.536325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:50.536602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:50.536894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:50.537175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:50.541027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:50.544904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:50.547138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:50.750467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:50.752274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:50.763139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1045/2093] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:18:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:18:50.763328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6185ff-3946-42cc-93d0-84db2e382dc5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:50.764075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:50.765520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:50.782170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e49277-3079-4273-8f60-553eed5c9cdb service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:50.782807 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:50.784748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:50.784748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:50.787665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:50.788090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] PATH_INFO: `/v3/projects/dcf7717e320e4246b36fa2bc4ec3bbb0` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:50.788368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:50.788652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:50.788927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] PATH_INFO: `/v3/projects/af51fa77ac47453e8e0f15be1c624a5e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:50.790116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af51fa77ac47453e8e0f15be1c624a5e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:50.792418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:50.794401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf7717e320e4246b36fa2bc4ec3bbb0)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:50.796551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:50.999170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af51fa77ac47453e8e0f15be1c624a5e', 'request_id': 'req-0c9d6426-0af1-4810-8927-7a88e62be910'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.030696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf7717e320e4246b36fa2bc4ec3bbb0', 'request_id': 'req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.107466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af51fa77ac47453e8e0f15be1c624a5e', 'request_id': 'req-0c9d6426-0af1-4810-8927-7a88e62be910'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.117653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af51fa77ac47453e8e0f15be1c624a5e', 'request_id': 'req-0c9d6426-0af1-4810-8927-7a88e62be910'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.134880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] The token cache is being invalidate because project af51fa77ac47453e8e0f15be1c624a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:51.135597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.136861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.148404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1046/2094] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:50 2022] DELETE /identity/v3/projects/af51fa77ac47453e8e0f15be1c624a5e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:51.149642 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:51.152643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:51.214339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf7717e320e4246b36fa2bc4ec3bbb0', 'request_id': 'req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.237717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf7717e320e4246b36fa2bc4ec3bbb0', 'request_id': 'req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.300114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d6426-0af1-4810-8927-7a88e62be910 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:51.333341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] The token cache is being invalidate because project dcf7717e320e4246b36fa2bc4ec3bbb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:51.333891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.336911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.351303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1049/2095] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:50 2022] DELETE /identity/v3/projects/dcf7717e320e4246b36fa2bc4ec3bbb0 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:18:51.355955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:51.365333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:51.460696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:51.460696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:51.460696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:51.461707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] PATH_INFO: `/v3/users/6bbf1f37ca99441c95af6ecc6e7476bb` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:51.463441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbf1f37ca99441c95af6ecc6e7476bb)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:51.465488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:51.577464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d2a8a-67ae-4d67-bf47-9acc2d53b4fa admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:51.586728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:51.589122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:51.589754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:51.590572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] PATH_INFO: `/v3/projects/acf3e043901e4e109cd960f602e62adb` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:51.595144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf3e043901e4e109cd960f602e62adb)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:51.598548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:51.800774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbf1f37ca99441c95af6ecc6e7476bb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.801817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbf1f37ca99441c95af6ecc6e7476bb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:51.804264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf3e043901e4e109cd960f602e62adb', 'request_id': 'req-b2f3fb77-e69a-475a-b360-a9745fd70497'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:52.366104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbf1f37ca99441c95af6ecc6e7476bb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:52.368963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbf1f37ca99441c95af6ecc6e7476bb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:52.381556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dc622886-b933-417a-bc57-9f2d39384575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbf1f37ca99441c95af6ecc6e7476bb'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:52.394877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1047/2096] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:51 2022] DELETE /identity/v3/users/6bbf1f37ca99441c95af6ecc6e7476bb => generated 0 bytes in 1245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:52.398300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd34f-b2e3-4052-b664-da836b15d047 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:52.398300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd34f-b2e3-4052-b664-da836b15d047 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:52.398300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefd34f-b2e3-4052-b664-da836b15d047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:52.471155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ffefd34f-b2e3-4052-b664-da836b15d047 None None] MFA Rules not processed for user `218e551387574808b225e73b766b5062`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:52.473129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ffefd34f-b2e3-4052-b664-da836b15d047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:52.580268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf3e043901e4e109cd960f602e62adb', 'request_id': 'req-b2f3fb77-e69a-475a-b360-a9745fd70497'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:52.580892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1048/2097] 10.222.0.78 () {58 vars in 1015 bytes} [Mon Aug 29 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:52.580892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefd34f-b2e3-4052-b664-da836b15d047 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:52.580892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ffefd34f-b2e3-4052-b664-da836b15d047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:52.586960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf3e043901e4e109cd960f602e62adb', 'request_id': 'req-b2f3fb77-e69a-475a-b360-a9745fd70497'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:52.618009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] The token cache is being invalidate because project acf3e043901e4e109cd960f602e62adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:52.618009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:52.618009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:52.618009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1050/2098] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:51 2022] DELETE /identity/v3/projects/acf3e043901e4e109cd960f602e62adb => generated 0 bytes in 1259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:52.618009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:52.618425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:52.701059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefd34f-b2e3-4052-b664-da836b15d047 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:52.714170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:52.744203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:52.745137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:52.745773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:52.746200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] PATH_INFO: `/v3/users/18607988fb4a405fb54d240ad9873dad` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:52.747652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] RBAC: Authorizing `identity:delete_user(user_id=18607988fb4a405fb54d240ad9873dad)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:52.752199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:52.761194 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3fb77-e69a-475a-b360-a9745fd70497 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:52.767137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c15cfc-e0bd-4319-a76f-eae4ca240f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:52.767137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c15cfc-e0bd-4319-a76f-eae4ca240f20 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:52.767371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c15cfc-e0bd-4319-a76f-eae4ca240f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:52.767636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c15cfc-e0bd-4319-a76f-eae4ca240f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:52.769949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-06c15cfc-e0bd-4319-a76f-eae4ca240f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:52.782397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c15cfc-e0bd-4319-a76f-eae4ca240f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:52.784426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c15cfc-e0bd-4319-a76f-eae4ca240f20 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:52.793896 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1051/2099] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:52.795492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd7cf-8e78-46d4-9363-077984fab33b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:52.795963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd7cf-8e78-46d4-9363-077984fab33b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:52.796405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bd7cf-8e78-46d4-9363-077984fab33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:52.857775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-090bd7cf-8e78-46d4-9363-077984fab33b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:52.858975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-090bd7cf-8e78-46d4-9363-077984fab33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:52.884746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1052/2100] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:52.888006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02d38-28a2-4d78-9d82-6216fe160460 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:52.889903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02d38-28a2-4d78-9d82-6216fe160460 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:52.890410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02d38-28a2-4d78-9d82-6216fe160460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:52.999930 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7dd02d38-28a2-4d78-9d82-6216fe160460 None None] MFA Rules not processed for user `276a222a300c4f70a27dbefdd3a64324`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:53.001545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7dd02d38-28a2-4d78-9d82-6216fe160460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:53.074192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18607988fb4a405fb54d240ad9873dad'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.076098 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18607988fb4a405fb54d240ad9873dad'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.178375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18607988fb4a405fb54d240ad9873dad'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.179035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18607988fb4a405fb54d240ad9873dad'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.185155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1053/2101] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:53.185155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd1684-12d3-4b2f-ae98-c07b0e269f87 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:53.185155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd1684-12d3-4b2f-ae98-c07b0e269f87 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:53.185155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd1684-12d3-4b2f-ae98-c07b0e269f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:53.198573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18607988fb4a405fb54d240ad9873dad'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.221995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-11fd1684-12d3-4b2f-ae98-c07b0e269f87 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:53.227510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-11fd1684-12d3-4b2f-ae98-c07b0e269f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:53.256133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1049/2102] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:52 2022] DELETE /identity/v3/users/18607988fb4a405fb54d240ad9873dad => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:53.256133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:53.258049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:53.399812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3b96b-9988-496e-8e1d-c78aa77d377a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:53.413677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99819e83-74d2-494d-ae3c-f98e240a99bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:53.416606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99819e83-74d2-494d-ae3c-f98e240a99bc admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:53.416606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99819e83-74d2-494d-ae3c-f98e240a99bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:53.416606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99819e83-74d2-494d-ae3c-f98e240a99bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:53.416606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99819e83-74d2-494d-ae3c-f98e240a99bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:53.417416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99819e83-74d2-494d-ae3c-f98e240a99bc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:53.419625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1054/2103] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:53.420901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd1684-12d3-4b2f-ae98-c07b0e269f87 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:53.423953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-11fd1684-12d3-4b2f-ae98-c07b0e269f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:53.445104 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd1684-12d3-4b2f-ae98-c07b0e269f87 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:53.460470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:53.463358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:53.464962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:53.465974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] PATH_INFO: `/v3/projects/4323c56553eb47e192bb5d2305609b86` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:53.470863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4323c56553eb47e192bb5d2305609b86)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:53.477051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:53.569798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1050/2104] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:53 2022] POST /identity/v3/projects => generated 405 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:53.576323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99819e83-74d2-494d-ae3c-f98e240a99bc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:53.642388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:53.734447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4323c56553eb47e192bb5d2305609b86', 'request_id': 'req-3621248f-1a96-4057-aeb4-00f3bc2dd525'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.763672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99819e83-74d2-494d-ae3c-f98e240a99bc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:53.846508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4323c56553eb47e192bb5d2305609b86', 'request_id': 'req-3621248f-1a96-4057-aeb4-00f3bc2dd525'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.857510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4323c56553eb47e192bb5d2305609b86', 'request_id': 'req-3621248f-1a96-4057-aeb4-00f3bc2dd525'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.898356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:53.899628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:53.899795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] The token cache is being invalidate because project 4323c56553eb47e192bb5d2305609b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:53.900169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:53.900697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.901337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:53.902174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:53.902481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:53.903011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:53.904077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1055/2105] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:53 2022] DELETE /identity/v3/projects/4323c56553eb47e192bb5d2305609b86 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:53.904728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:53.904954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:53.908334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:53.925896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1051/2106] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:53.938607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:53.938849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621248f-1a96-4057-aeb4-00f3bc2dd525 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:53.942747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:53.944312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:53.945223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:53.952294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:53.953682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] PATH_INFO: `/v3/users/ee1069f0ab174be99b19e00f9bf6cbc6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:53.955323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1069f0ab174be99b19e00f9bf6cbc6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:53.958819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:53.985480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512e98d3-0582-42a3-9380-474e2590c21b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:54.001545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c20f19-640f-432f-a0bd-96f3145e922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:54.001545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c20f19-640f-432f-a0bd-96f3145e922e admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.001545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c20f19-640f-432f-a0bd-96f3145e922e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.002581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c20f19-640f-432f-a0bd-96f3145e922e admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.003280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c20f19-640f-432f-a0bd-96f3145e922e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:54.007219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c20f19-640f-432f-a0bd-96f3145e922e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:54.147903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1052/2107] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:53 2022] POST /identity/v3/users => generated 309 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:54.150435 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12045476-9397-4c3e-9576-7a2da16cbd6d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.158559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12045476-9397-4c3e-9576-7a2da16cbd6d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.158559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12045476-9397-4c3e-9576-7a2da16cbd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.197798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-12045476-9397-4c3e-9576-7a2da16cbd6d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:54.202184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-12045476-9397-4c3e-9576-7a2da16cbd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:54.223254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1053/2108] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:54.223535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12045476-9397-4c3e-9576-7a2da16cbd6d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:54.228628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-12045476-9397-4c3e-9576-7a2da16cbd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:54.245131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12045476-9397-4c3e-9576-7a2da16cbd6d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:54.252666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:54.257284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:54.257284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.257284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.257284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.257983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:54.260123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:54.326651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1069f0ab174be99b19e00f9bf6cbc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:54.402295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1054/2109] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:54 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:54.403431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:54.405262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:54.418631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1069f0ab174be99b19e00f9bf6cbc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:54.421065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1069f0ab174be99b19e00f9bf6cbc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:54.449901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1069f0ab174be99b19e00f9bf6cbc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:54.450684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1069f0ab174be99b19e00f9bf6cbc6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:54.467658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1056/2110] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:53 2022] DELETE /identity/v3/users/ee1069f0ab174be99b19e00f9bf6cbc6 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:54.471618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:54.475410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:54.503588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fc345-35bb-480d-89c5-b5e6d24a59d6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:54.605762 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7be70-aded-4c79-98e8-6bb5c30ba87e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:54.612610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3e169-5261-4359-a6eb-27be539ed6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:54.612610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e169-5261-4359-a6eb-27be539ed6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.612976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e169-5261-4359-a6eb-27be539ed6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.613328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3e169-5261-4359-a6eb-27be539ed6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.614040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3e169-5261-4359-a6eb-27be539ed6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:54.615923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3e169-5261-4359-a6eb-27be539ed6b4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:54.621464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:54.622564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.622564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.623020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] PATH_INFO: `/v3/projects/1c029a3442e54a9e9276c4f8f7a26288` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.624359 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c029a3442e54a9e9276c4f8f7a26288)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:54.626546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:54.633569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1057/2111] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:54.635158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5fb78-d396-4c7e-83b9-7533052ebb18 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.635443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5fb78-d396-4c7e-83b9-7533052ebb18 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.635820 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5fb78-d396-4c7e-83b9-7533052ebb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.659588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3aa5fb78-d396-4c7e-83b9-7533052ebb18 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:54.660950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3aa5fb78-d396-4c7e-83b9-7533052ebb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:54.671186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1058/2112] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:54.672424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5fb78-d396-4c7e-83b9-7533052ebb18 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:54.679623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3aa5fb78-d396-4c7e-83b9-7533052ebb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:54.690829 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5fb78-d396-4c7e-83b9-7533052ebb18 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:54.698607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acda6cd-3218-4086-af15-4086c78eac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:54.699286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda6cd-3218-4086-af15-4086c78eac71 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.699582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda6cd-3218-4086-af15-4086c78eac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.699989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acda6cd-3218-4086-af15-4086c78eac71 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.700777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acda6cd-3218-4086-af15-4086c78eac71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:54.703396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acda6cd-3218-4086-af15-4086c78eac71 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:54.850623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c029a3442e54a9e9276c4f8f7a26288', 'request_id': 'req-44a8a951-f911-48f4-8d89-ac0c8af70fb0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:54.882138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1059/2113] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:54 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:54.883763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da80c9-79d2-4ede-8374-cca5e71e614e None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.897565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da80c9-79d2-4ede-8374-cca5e71e614e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.897565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da80c9-79d2-4ede-8374-cca5e71e614e None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.897565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1060/2114] 10.222.0.82 () {54 vars in 921 bytes} [Mon Aug 29 19:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:18:54.897565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2b25-40ad-426a-900e-1b7ce9b91cea None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:54.897565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2b25-40ad-426a-900e-1b7ce9b91cea None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:54.897565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff2b25-40ad-426a-900e-1b7ce9b91cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:54.913245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-82ff2b25-40ad-426a-900e-1b7ce9b91cea None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:54.914531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-82ff2b25-40ad-426a-900e-1b7ce9b91cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:54.991689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1061/2115] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:54.992823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff2b25-40ad-426a-900e-1b7ce9b91cea None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.005847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff2b25-40ad-426a-900e-1b7ce9b91cea None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:55.012263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fde5a-934c-44cc-b739-7779b6981d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:55.013004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fde5a-934c-44cc-b739-7779b6981d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.013388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fde5a-934c-44cc-b739-7779b6981d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.013675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fde5a-934c-44cc-b739-7779b6981d4c admin admin] PATH_INFO: `/v3/projects/493f15f771a44d8e90c0b33e918f4c0c/users/d48d9a58486f413681506c45609cb2c3/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.019668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c029a3442e54a9e9276c4f8f7a26288', 'request_id': 'req-44a8a951-f911-48f4-8d89-ac0c8af70fb0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:55.029490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c029a3442e54a9e9276c4f8f7a26288', 'request_id': 'req-44a8a951-f911-48f4-8d89-ac0c8af70fb0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:55.034543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fde5a-934c-44cc-b739-7779b6981d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=493f15f771a44d8e90c0b33e918f4c0c, user_id=d48d9a58486f413681506c45609cb2c3, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:55.037285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fde5a-934c-44cc-b739-7779b6981d4c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:55.069429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] The token cache is being invalidate because project 1c029a3442e54a9e9276c4f8f7a26288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:55.070069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:55.071111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:55.076555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1055/2116] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:54 2022] DELETE /identity/v3/projects/1c029a3442e54a9e9276c4f8f7a26288 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:55.077594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.081943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.118158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a951-f911-48f4-8d89-ac0c8af70fb0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:55.125830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:55.130705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.130705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.130705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.130705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:55.130705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:55.131284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:55.159830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1056/2117] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:55.161486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.165335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1062/2118] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:54 2022] PUT /identity/v3/projects/493f15f771a44d8e90c0b33e918f4c0c/users/d48d9a58486f413681506c45609cb2c3/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:55.165335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40f09-5419-4613-abb4-5d6761f848a8 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.165335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40f09-5419-4613-abb4-5d6761f848a8 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.165745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.165847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd40f09-5419-4613-abb4-5d6761f848a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.197350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dca01-cfe9-4f72-8cf2-b6f5b220014d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:55.212751 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bbd40f09-5419-4613-abb4-5d6761f848a8 None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:55.214147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bbd40f09-5419-4613-abb4-5d6761f848a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.342253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:55.343154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.343602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.344088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.347282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:55.349560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:55.378901 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1057/2119] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:55.379824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.386632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.423204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1063/2120] 10.222.0.82 () {58 vars in 1018 bytes} [Mon Aug 29 19:18:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:55.425451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42afa-d1d7-4f2b-a683-9d89d4dfdf86 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.425745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42afa-d1d7-4f2b-a683-9d89d4dfdf86 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.426024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42afa-d1d7-4f2b-a683-9d89d4dfdf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.452336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d7d42afa-d1d7-4f2b-a683-9d89d4dfdf86 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:55.454543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7d42afa-d1d7-4f2b-a683-9d89d4dfdf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.466507 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1064/2121] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:55.467466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d42afa-d1d7-4f2b-a683-9d89d4dfdf86 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.485725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d42afa-d1d7-4f2b-a683-9d89d4dfdf86 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:55.488809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6069c93-2dea-4033-a7a1-75c6b5800dd9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:55.496378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:55.496378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.496378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.496378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.496740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:55.497697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:55.498189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:55.500132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.500762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.501388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.505078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.552959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:55.556564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:55.588047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1058/2122] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:55.588856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.594822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.625880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902365ca-3470-42c3-b7fd-8553124e11e2 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:55.634168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827698d9-f914-4bba-97de-a2456f10140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:55.635170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827698d9-f914-4bba-97de-a2456f10140a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.636179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827698d9-f914-4bba-97de-a2456f10140a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.636468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827698d9-f914-4bba-97de-a2456f10140a admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.637979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827698d9-f914-4bba-97de-a2456f10140a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:55.639962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827698d9-f914-4bba-97de-a2456f10140a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:55.682754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1065/2123] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:55 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:55.682960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1059/2124] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:55.682960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827698d9-f914-4bba-97de-a2456f10140a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.685555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.689862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.702693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827698d9-f914-4bba-97de-a2456f10140a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:55.839972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:55.840957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.841507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.841992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.842867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:55.845022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:55.859413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1060/2125] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:55.861017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:55.863978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e7c7b-89c5-43ba-90ef-66e4a5eb2d2b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:55.864764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:55.892422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:55.893333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:55.893691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:55.894099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] PATH_INFO: `/v3/users/8d53a7f6623947878317c176e1a202c0` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:55.895908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d53a7f6623947878317c176e1a202c0)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:55.898260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:55.925445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:56.044616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b191c2-bc28-4e73-94b1-b3b4cc8a96bd admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:56.053313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8268e-5848-4a6b-958e-362452c5a652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:56.053953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8268e-5848-4a6b-958e-362452c5a652 service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:56.054246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8268e-5848-4a6b-958e-362452c5a652 service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:56.054523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8268e-5848-4a6b-958e-362452c5a652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:56.069931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8268e-5848-4a6b-958e-362452c5a652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:56.073414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8268e-5848-4a6b-958e-362452c5a652 service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:56.091099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1061/2126] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:56.093071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d2f6-5376-4159-a4d3-23339c384119 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:56.093437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d2f6-5376-4159-a4d3-23339c384119 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:56.093788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d2f6-5376-4159-a4d3-23339c384119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:56.126109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7c32d2f6-5376-4159-a4d3-23339c384119 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:56.127748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7c32d2f6-5376-4159-a4d3-23339c384119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:56.158726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1062/2127] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:56.167185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d2f6-5376-4159-a4d3-23339c384119 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:56.184600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d2f6-5376-4159-a4d3-23339c384119 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:56.189823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d532bd5-6b6f-4b28-936f-fa28fe34dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:56.191782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d532bd5-6b6f-4b28-936f-fa28fe34dfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:56.192108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d532bd5-6b6f-4b28-936f-fa28fe34dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:56.192389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d532bd5-6b6f-4b28-936f-fa28fe34dfb9 admin admin] PATH_INFO: `/v3/projects/493f15f771a44d8e90c0b33e918f4c0c/users/d48d9a58486f413681506c45609cb2c3/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:56.196109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d532bd5-6b6f-4b28-936f-fa28fe34dfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=493f15f771a44d8e90c0b33e918f4c0c, user_id=d48d9a58486f413681506c45609cb2c3, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:56.214315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d532bd5-6b6f-4b28-936f-fa28fe34dfb9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:56.240796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1063/2128] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:56 2022] PUT /identity/v3/projects/493f15f771a44d8e90c0b33e918f4c0c/users/d48d9a58486f413681506c45609cb2c3/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:56.240796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d532bd5-6b6f-4b28-936f-fa28fe34dfb9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:56.271223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d53a7f6623947878317c176e1a202c0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:56.340256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d532bd5-6b6f-4b28-936f-fa28fe34dfb9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:56.345691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:56.348486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:56.348486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:56.348486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:56.348486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:56.350098 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:56.411422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d53a7f6623947878317c176e1a202c0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:56.413536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d53a7f6623947878317c176e1a202c0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:56.446021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d53a7f6623947878317c176e1a202c0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:56.447034 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d53a7f6623947878317c176e1a202c0'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:56.486081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1066/2129] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:55 2022] DELETE /identity/v3/users/8d53a7f6623947878317c176e1a202c0 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:56.491885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:56.499035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:56.528223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1064/2130] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:56 2022] POST /identity/v3/users => generated 283 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:56.529094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:56.531488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:56.555177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61f078-559c-4468-9a9f-02075dc2e134 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:56.629920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca96519-40ef-4bc1-b14b-208ebc2da2fd admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:56.636296 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2fbbc-f789-4567-9d1b-453ca4eb45e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:56.637069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2fbbc-f789-4567-9d1b-453ca4eb45e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:56.637462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2fbbc-f789-4567-9d1b-453ca4eb45e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:56.637809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2fbbc-f789-4567-9d1b-453ca4eb45e6 admin admin] PATH_INFO: `/v3/projects/65592f46266a47b1b3b137e10295545a/users/0cd163fdd7cf485696bff3395b7781b6/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:56.657456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2fbbc-f789-4567-9d1b-453ca4eb45e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65592f46266a47b1b3b137e10295545a, user_id=0cd163fdd7cf485696bff3395b7781b6, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:56.661970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2fbbc-f789-4567-9d1b-453ca4eb45e6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:56.680048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:56.680986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:56.682085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:56.682538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:56.683380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:18:56.683877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:56.686046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:56.702502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1065/2131] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:18:56.703492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:56.709035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:56.726438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f15315-d2ca-402f-83b3-7aca96661623 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:56.733830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:56.734538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:56.734823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:56.735099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] PATH_INFO: `/v3/projects/e00903a737274c4d8bc70edc0b6887ae` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:56.736500 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00903a737274c4d8bc70edc0b6887ae)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:56.739678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:56.783652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1067/2132] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:56 2022] PUT /identity/v3/projects/65592f46266a47b1b3b137e10295545a/users/0cd163fdd7cf485696bff3395b7781b6/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:56.794484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f793a9-e49f-480f-bc2a-5805ae3f6942 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:56.794764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f793a9-e49f-480f-bc2a-5805ae3f6942 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:56.795048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f793a9-e49f-480f-bc2a-5805ae3f6942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:56.830188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-b8f793a9-e49f-480f-bc2a-5805ae3f6942 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:56.832772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b8f793a9-e49f-480f-bc2a-5805ae3f6942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:56.915451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00903a737274c4d8bc70edc0b6887ae', 'request_id': 'req-61d1d196-9f9c-4848-8f17-47c99554aee4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:56.936615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1068/2133] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:56.937989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f793a9-e49f-480f-bc2a-5805ae3f6942 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:56.939449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b8f793a9-e49f-480f-bc2a-5805ae3f6942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:56.954780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f793a9-e49f-480f-bc2a-5805ae3f6942 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:56.998865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00903a737274c4d8bc70edc0b6887ae', 'request_id': 'req-61d1d196-9f9c-4848-8f17-47c99554aee4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.011215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00903a737274c4d8bc70edc0b6887ae', 'request_id': 'req-61d1d196-9f9c-4848-8f17-47c99554aee4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.040191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] The token cache is being invalidate because project e00903a737274c4d8bc70edc0b6887ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:57.040877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.042400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.050395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1066/2134] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:56 2022] DELETE /identity/v3/projects/e00903a737274c4d8bc70edc0b6887ae => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:57.052522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:57.053786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4584e5d-b0ee-474f-9147-ed4978f320e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:57.054558 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584e5d-b0ee-474f-9147-ed4978f320e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:57.054892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584e5d-b0ee-474f-9147-ed4978f320e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:57.055235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4584e5d-b0ee-474f-9147-ed4978f320e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:57.055969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:57.056097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4584e5d-b0ee-474f-9147-ed4978f320e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:57.058066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4584e5d-b0ee-474f-9147-ed4978f320e6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:57.074089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1069/2135] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:57.075777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91034f3-193f-4084-81af-eac375bcec7d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:57.076150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91034f3-193f-4084-81af-eac375bcec7d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:57.076510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91034f3-193f-4084-81af-eac375bcec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:57.109878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:57.114567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1d196-9f9c-4848-8f17-47c99554aee4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:57.130302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:57.131879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:57.132399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d91034f3-193f-4084-81af-eac375bcec7d None None] MFA Rules not processed for user `0cd163fdd7cf485696bff3395b7781b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:57.133348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:57.134195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:57.135250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d91034f3-193f-4084-81af-eac375bcec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:57.136287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:57.138717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:57.246657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:57.271889 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1067/2136] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:57 2022] POST /identity/v3/projects => generated 369 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:57.276233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:57.278730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1070/2137] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:57.279846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91034f3-193f-4084-81af-eac375bcec7d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:57.280618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:57.285491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d91034f3-193f-4084-81af-eac375bcec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:57.320764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91034f3-193f-4084-81af-eac375bcec7d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:57.453410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f79da-dd4c-4b4c-bdd2-dfda35f174be admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:57.465043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:57.465043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:57.465517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:57.465959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:57.469941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:57.471517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:57.472381 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:57.473106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:57.473742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] PATH_INFO: `/v3/users/8ec2b77aee784c64bacb2eb2724cacfd` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:57.475386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec2b77aee784c64bacb2eb2724cacfd)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:57.478472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:57.487259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:57.499244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:57.505031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1068/2138] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:57.506349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:57.514004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:57.536106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926de1df-58a6-42a8-8f9a-69122f2ec035 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:57.548374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad441-6c5a-4fbb-b745-2a6da300321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:57.548745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad441-6c5a-4fbb-b745-2a6da300321b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:57.548956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad441-6c5a-4fbb-b745-2a6da300321b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:57.549878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad441-6c5a-4fbb-b745-2a6da300321b admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:57.551034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ad441-6c5a-4fbb-b745-2a6da300321b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:57.552965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ad441-6c5a-4fbb-b745-2a6da300321b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:57.566227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1069/2139] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:57.567261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad441-6c5a-4fbb-b745-2a6da300321b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:57.580381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad441-6c5a-4fbb-b745-2a6da300321b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:57.586376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:57.587072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:57.587354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:57.587629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:57.589309 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:57.590381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:57.689615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1070/2140] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:57 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:57.689615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:57.692337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:57.751611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec2b77aee784c64bacb2eb2724cacfd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.787243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4dcd3-1e42-4152-b9e8-a09e2b2b26da admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:57.793579 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915df5-a887-4344-98d4-3856df70f23e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:57.794677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915df5-a887-4344-98d4-3856df70f23e service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:57.794921 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915df5-a887-4344-98d4-3856df70f23e service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:57.795423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915df5-a887-4344-98d4-3856df70f23e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:57.829200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec2b77aee784c64bacb2eb2724cacfd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.830443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec2b77aee784c64bacb2eb2724cacfd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.859395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec2b77aee784c64bacb2eb2724cacfd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.867166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec2b77aee784c64bacb2eb2724cacfd'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:57.903983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1071/2141] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:57 2022] DELETE /identity/v3/users/8ec2b77aee784c64bacb2eb2724cacfd => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:57.905122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:57.910110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:57.944914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915df5-a887-4344-98d4-3856df70f23e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:57.947572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915df5-a887-4344-98d4-3856df70f23e service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:57.973946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1071/2142] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:57.975456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915df5-a887-4344-98d4-3856df70f23e service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:58.008184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915df5-a887-4344-98d4-3856df70f23e service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:58.011888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb588c34-d227-4867-af1a-a547975538a5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:58.016903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08fa46-5da3-452e-8e7c-f18da18e6bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:58.017728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fa46-5da3-452e-8e7c-f18da18e6bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:58.017997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fa46-5da3-452e-8e7c-f18da18e6bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:58.018350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fa46-5da3-452e-8e7c-f18da18e6bbb admin admin] PATH_INFO: `/v3/projects/64ae8101b8594bde95f143b06ee871b3/users/574f424898764cf78efef8c91054946a/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:58.019904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:58.022034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:58.022445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:58.022978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:58.024462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:58.028836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:58.039147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08fa46-5da3-452e-8e7c-f18da18e6bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ae8101b8594bde95f143b06ee871b3, user_id=574f424898764cf78efef8c91054946a, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:58.042508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08fa46-5da3-452e-8e7c-f18da18e6bbb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:58.070067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1072/2143] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:58.074280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:58.076293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:58.102303 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7bc32-abcf-49a2-b66d-a4776a414d1a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:58.118436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a198e-8a5f-402d-8de7-7dbf529e3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:58.119141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a198e-8a5f-402d-8de7-7dbf529e3dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:58.119413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a198e-8a5f-402d-8de7-7dbf529e3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:58.119756 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a198e-8a5f-402d-8de7-7dbf529e3dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:58.120423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a198e-8a5f-402d-8de7-7dbf529e3dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:58.122434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a198e-8a5f-402d-8de7-7dbf529e3dbf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:58.150459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1073/2144] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:18:58.151640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a198e-8a5f-402d-8de7-7dbf529e3dbf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:58.165243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1072/2145] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:57 2022] PUT /identity/v3/projects/64ae8101b8594bde95f143b06ee871b3/users/574f424898764cf78efef8c91054946a/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:58.176293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c493c1-e334-4fe5-8f5b-92179dd619f9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:58.176615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c493c1-e334-4fe5-8f5b-92179dd619f9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:58.176843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c493c1-e334-4fe5-8f5b-92179dd619f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:58.194107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a198e-8a5f-402d-8de7-7dbf529e3dbf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:58.265410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e4c493c1-e334-4fe5-8f5b-92179dd619f9 None None] MFA Rules not processed for user `574f424898764cf78efef8c91054946a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:58.274678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e4c493c1-e334-4fe5-8f5b-92179dd619f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:58.324437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcde9f-838f-453b-93f2-b848e1511d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:58.327674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcde9f-838f-453b-93f2-b848e1511d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:58.328079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcde9f-838f-453b-93f2-b848e1511d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:58.328527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcde9f-838f-453b-93f2-b848e1511d78 admin admin] PATH_INFO: `/v3/projects/d2823d8f0c9c42d290867f29978aa397/users/942b97c444d24165b775b34190eac8da/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:58.366162 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcde9f-838f-453b-93f2-b848e1511d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2823d8f0c9c42d290867f29978aa397, user_id=942b97c444d24165b775b34190eac8da, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:58.370654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcde9f-838f-453b-93f2-b848e1511d78 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:58.457510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1073/2146] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:58.464443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c493c1-e334-4fe5-8f5b-92179dd619f9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:58.487569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1074/2147] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:58 2022] PUT /identity/v3/projects/d2823d8f0c9c42d290867f29978aa397/users/942b97c444d24165b775b34190eac8da/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:58.494474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30eb10-50b7-4b87-ab71-075ff09d8489 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:58.495166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30eb10-50b7-4b87-ab71-075ff09d8489 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:58.495461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30eb10-50b7-4b87-ab71-075ff09d8489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:58.504268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c493c1-e334-4fe5-8f5b-92179dd619f9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:58.579926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5c30eb10-50b7-4b87-ab71-075ff09d8489 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:58.581751 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5c30eb10-50b7-4b87-ab71-075ff09d8489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:58.772034 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:58.774274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:58.774274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:58.774274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:58.775036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:58.777730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:58.810259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1075/2148] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:58.822798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30eb10-50b7-4b87-ab71-075ff09d8489 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:58.824997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5c30eb10-50b7-4b87-ab71-075ff09d8489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:58.915104 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1074/2149] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:18:58 2022] POST /identity/v3/projects => generated 367 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:58.917630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:58.941516 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:59.082417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30eb10-50b7-4b87-ab71-075ff09d8489 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:59.138272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:59.185711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0073abe-d34a-46c9-aff7-0c30f8c82d3c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:59.201185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:59.207871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:59.213996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:59.214293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] PATH_INFO: `/v3/projects/0453767a5e8740a4afcfd105562f393f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:59.219459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0453767a5e8740a4afcfd105562f393f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:59.220644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca60e-17d1-4799-9dc0-120321494606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:59.226068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca60e-17d1-4799-9dc0-120321494606 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:59.226068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca60e-17d1-4799-9dc0-120321494606 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:59.226068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ca60e-17d1-4799-9dc0-120321494606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:59.226360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:59.240659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ca60e-17d1-4799-9dc0-120321494606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:59.243809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ca60e-17d1-4799-9dc0-120321494606 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:59.256469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1076/2150] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:18:59.257959 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:59.259519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca60e-17d1-4799-9dc0-120321494606 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:59.272566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ca60e-17d1-4799-9dc0-120321494606 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:59.279298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:59.280314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:59.280980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:59.281476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:59.282353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:59.284871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:59.396252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0453767a5e8740a4afcfd105562f393f', 'request_id': 'req-e88b0fea-9584-4aa7-8eac-99c4438457c4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.406953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1077/2151] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:18:59 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:18:59.407930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:59.412922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:59.445691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429259e-a3ba-4257-bc3d-07fecc8df42a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:59.543943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0453767a5e8740a4afcfd105562f393f', 'request_id': 'req-e88b0fea-9584-4aa7-8eac-99c4438457c4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.566446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0453767a5e8740a4afcfd105562f393f', 'request_id': 'req-e88b0fea-9584-4aa7-8eac-99c4438457c4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.577076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:59.579640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:59.579640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:59.579640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] PATH_INFO: `/v3/projects/b5f31208cb5a46719798f1a37df1549f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:59.579640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f31208cb5a46719798f1a37df1549f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:59.582591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:59.594975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] The token cache is being invalidate because project 0453767a5e8740a4afcfd105562f393f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:59.595535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.602862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e88b0fea-9584-4aa7-8eac-99c4438457c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.602862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1075/2152] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:58 2022] DELETE /identity/v3/projects/0453767a5e8740a4afcfd105562f393f => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:59.608952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfecd0f-ec47-42c7-91c9-2a3659cad800 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:59.609247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfecd0f-ec47-42c7-91c9-2a3659cad800 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:59.609819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfecd0f-ec47-42c7-91c9-2a3659cad800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:59.670712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8cfecd0f-ec47-42c7-91c9-2a3659cad800 None None] MFA Rules not processed for user `d48d9a58486f413681506c45609cb2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:59.671986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8cfecd0f-ec47-42c7-91c9-2a3659cad800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:59.764716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1076/2153] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:59.765703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfecd0f-ec47-42c7-91c9-2a3659cad800 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:59.769835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8cfecd0f-ec47-42c7-91c9-2a3659cad800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:59.797986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfecd0f-ec47-42c7-91c9-2a3659cad800 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:59.818739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f31208cb5a46719798f1a37df1549f', 'request_id': 'req-5a9d63c5-4a72-40a5-8177-43bba9620ec6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.885953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f31208cb5a46719798f1a37df1549f', 'request_id': 'req-5a9d63c5-4a72-40a5-8177-43bba9620ec6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.896530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f31208cb5a46719798f1a37df1549f', 'request_id': 'req-5a9d63c5-4a72-40a5-8177-43bba9620ec6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.923033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:59.923753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:59.925026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:59.925026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:59.925331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] The token cache is being invalidate because project b5f31208cb5a46719798f1a37df1549f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:18:59.925910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:59.928626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:59.931855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.933157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-5a9d63c5-4a72-40a5-8177-43bba9620ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:18:59.938134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1078/2154] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:18:59 2022] DELETE /identity/v3/projects/b5f31208cb5a46719798f1a37df1549f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:18:59.938587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c696-8624-4811-88ba-ce387ed7ebaf None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:59.940769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c696-8624-4811-88ba-ce387ed7ebaf None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:59.941085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846c696-8624-4811-88ba-ce387ed7ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:59.943947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1077/2155] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:18:59.945542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:59.948479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:59.972723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc582645-4b41-40e2-9738-4c4cdb143780 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:18:59.978246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d846c696-8624-4811-88ba-ce387ed7ebaf None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:18:59.980136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:18:59.980842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d846c696-8624-4811-88ba-ce387ed7ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:18:59.981494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:18:59.982273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:18:59.982723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] PATH_INFO: `/v3/users/bd9ea292a6d44babacb5d6b971c0ee65` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:18:59.985373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9ea292a6d44babacb5d6b971c0ee65)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:18:59.988839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:18:59.993547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1079/2156] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:18:59.994592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846c696-8624-4811-88ba-ce387ed7ebaf None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:18:59.996011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d846c696-8624-4811-88ba-ce387ed7ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:00.015774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846c696-8624-4811-88ba-ce387ed7ebaf None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:00.024583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6faed-867f-409a-8bc4-b023849cbe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:00.026078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6faed-867f-409a-8bc4-b023849cbe80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:00.026231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6faed-867f-409a-8bc4-b023849cbe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:00.026656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6faed-867f-409a-8bc4-b023849cbe80 admin admin] PATH_INFO: `/v3/projects/8ee1923c06284997acb432b92f2a60f2/users/45854ea06bde4346997e2d11d5bd5de4/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:00.052448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6faed-867f-409a-8bc4-b023849cbe80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee1923c06284997acb432b92f2a60f2, user_id=45854ea06bde4346997e2d11d5bd5de4, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:00.056357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6faed-867f-409a-8bc4-b023849cbe80 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:00.139864 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1080/2157] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:18:59 2022] PUT /identity/v3/projects/8ee1923c06284997acb432b92f2a60f2/users/45854ea06bde4346997e2d11d5bd5de4/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:00.141357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda16f1-d2b7-4d3e-9607-3dca9602eab9 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:00.141648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda16f1-d2b7-4d3e-9607-3dca9602eab9 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:00.151785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda16f1-d2b7-4d3e-9607-3dca9602eab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:00.225783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5cda16f1-d2b7-4d3e-9607-3dca9602eab9 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:00.227754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5cda16f1-d2b7-4d3e-9607-3dca9602eab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:00.264983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9ea292a6d44babacb5d6b971c0ee65'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:00.372831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1081/2158] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:00.377192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda16f1-d2b7-4d3e-9607-3dca9602eab9 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:00.378749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9ea292a6d44babacb5d6b971c0ee65'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:00.379769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9ea292a6d44babacb5d6b971c0ee65'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:00.415647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9ea292a6d44babacb5d6b971c0ee65'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:00.417657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9ea292a6d44babacb5d6b971c0ee65'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:00.425012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda16f1-d2b7-4d3e-9607-3dca9602eab9 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:00.438109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:00.445709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:00.446223 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:00.447375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:00.450050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:00.453458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:00.459862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1078/2159] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:18:59 2022] DELETE /identity/v3/users/bd9ea292a6d44babacb5d6b971c0ee65 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:00.461392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:00.477723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:00.500851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1082/2160] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:00.504190 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:00.524134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:00.580327 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60280-188c-4327-b6ca-ef4d94d68cee admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:00.704959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174bb1-da94-4618-a978-4d39abe3b374 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:00.726314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:00.727228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112ff4a-a1d6-4d10-b5dc-596803aefca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:00.727367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:00.727546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:00.727890 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:00.728207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ff4a-a1d6-4d10-b5dc-596803aefca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:00.728492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ff4a-a1d6-4d10-b5dc-596803aefca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:00.728731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:00.728848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ff4a-a1d6-4d10-b5dc-596803aefca4 admin admin] PATH_INFO: `/v3/projects/8ee1923c06284997acb432b92f2a60f2/users/45854ea06bde4346997e2d11d5bd5de4/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:00.729050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:00.735608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112ff4a-a1d6-4d10-b5dc-596803aefca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee1923c06284997acb432b92f2a60f2, user_id=45854ea06bde4346997e2d11d5bd5de4, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:00.742110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112ff4a-a1d6-4d10-b5dc-596803aefca4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:00.749474 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:00.804335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1083/2161] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:00 2022] PUT /identity/v3/projects/8ee1923c06284997acb432b92f2a60f2/users/45854ea06bde4346997e2d11d5bd5de4/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:00.819523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1079/2162] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:00.824269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142efb7-403f-442e-b4bc-f09e3f231404 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:00.824269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142efb7-403f-442e-b4bc-f09e3f231404 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:00.824269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142efb7-403f-442e-b4bc-f09e3f231404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:00.833843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:00.914533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7142efb7-403f-442e-b4bc-f09e3f231404 None None] MFA Rules not processed for user `45854ea06bde4346997e2d11d5bd5de4`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:00.916289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7142efb7-403f-442e-b4bc-f09e3f231404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:00.916472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d6fe1-ce0e-4118-908c-2f7f15a62e92 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:01.102588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1084/2163] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:01.169052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568899-755b-47ce-8df3-09aaa9dff759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:01.169693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568899-755b-47ce-8df3-09aaa9dff759 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:01.170683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568899-755b-47ce-8df3-09aaa9dff759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:01.171011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26568899-755b-47ce-8df3-09aaa9dff759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:01.171702 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568899-755b-47ce-8df3-09aaa9dff759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:01.183904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26568899-755b-47ce-8df3-09aaa9dff759 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:01.216974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142efb7-403f-442e-b4bc-f09e3f231404 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:01.219142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7142efb7-403f-442e-b4bc-f09e3f231404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:01.325854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142efb7-403f-442e-b4bc-f09e3f231404 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:01.334484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:01.336652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:01.337564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:01.340517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:01.357340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:01.358115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:01.359560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:01.365123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1080/2164] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:00 2022] POST /identity/v3/projects => generated 357 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:01.366213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568899-755b-47ce-8df3-09aaa9dff759 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:01.403249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1085/2165] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:01.517653 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26568899-755b-47ce-8df3-09aaa9dff759 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:01.529172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c9081-3fca-46d6-a6c4-38c0f4a2063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:01.529172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c9081-3fca-46d6-a6c4-38c0f4a2063a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:01.529172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c9081-3fca-46d6-a6c4-38c0f4a2063a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:01.529172 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c9081-3fca-46d6-a6c4-38c0f4a2063a admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:01.530431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c9081-3fca-46d6-a6c4-38c0f4a2063a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:01.532944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c9081-3fca-46d6-a6c4-38c0f4a2063a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:01.697694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:01.699542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1081/2166] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:01 2022] POST /identity/v3/users => generated 279 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:01.702143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:01.705600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c9081-3fca-46d6-a6c4-38c0f4a2063a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:01.726261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db1eda-fa23-43d9-8b7c-76a9a9c76fb1 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:01.733060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:01.734043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:01.734408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:01.734746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] PATH_INFO: `/v3/projects/27493af24348426cafbe338fa993e3e0` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:01.746921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c9081-3fca-46d6-a6c4-38c0f4a2063a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:01.751528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27493af24348426cafbe338fa993e3e0)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:01.757178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:01.762256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0a7de-4ca6-4c0a-9848-71f47d3842b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:01.763166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a7de-4ca6-4c0a-9848-71f47d3842b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:01.763545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a7de-4ca6-4c0a-9848-71f47d3842b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:01.763936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a7de-4ca6-4c0a-9848-71f47d3842b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:01.764703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0a7de-4ca6-4c0a-9848-71f47d3842b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:01.766560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0a7de-4ca6-4c0a-9848-71f47d3842b1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:01.806697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1082/2167] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:01.812251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0a7de-4ca6-4c0a-9848-71f47d3842b1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:01.859989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0a7de-4ca6-4c0a-9848-71f47d3842b1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:01.881168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:01.882096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:01.882598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:01.883115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:01.884021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:01.887563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:01.907290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1083/2168] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:01.907290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:01.907290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.004746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27493af24348426cafbe338fa993e3e0', 'request_id': 'req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:02.057703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1155b-aecc-486c-866d-02482bd66d91 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:02.082203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27493af24348426cafbe338fa993e3e0', 'request_id': 'req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:02.097441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27493af24348426cafbe338fa993e3e0', 'request_id': 'req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:02.118256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] The token cache is being invalidate because project 27493af24348426cafbe338fa993e3e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:02.119337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:02.121259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:02.125251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1086/2169] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:01 2022] DELETE /identity/v3/projects/27493af24348426cafbe338fa993e3e0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:02.126656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:02.129474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.180957 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f21aa-6e43-406f-875a-d0336887a861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:02.181522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f21aa-6e43-406f-875a-d0336887a861 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.182135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f21aa-6e43-406f-875a-d0336887a861 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.182793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f21aa-6e43-406f-875a-d0336887a861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.194544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6c3f21aa-6e43-406f-875a-d0336887a861 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.309925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3415414-d585-4f0e-a91b-f4bfb52e1c0f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:02.321545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a0bb1-643c-49cd-a594-9d5014746c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:02.322740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a0bb1-643c-49cd-a594-9d5014746c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.323229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a0bb1-643c-49cd-a594-9d5014746c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.323806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a0bb1-643c-49cd-a594-9d5014746c6c admin admin] PATH_INFO: `/v3/projects/ada3d8fcd577416aa83bd1d043ff3cc0/users/366fea775c414f9e92e840501fd4cf25/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.383621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a0bb1-643c-49cd-a594-9d5014746c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada3d8fcd577416aa83bd1d043ff3cc0, user_id=366fea775c414f9e92e840501fd4cf25, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:02.391622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a0bb1-643c-49cd-a594-9d5014746c6c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:02.406033 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f21aa-6e43-406f-875a-d0336887a861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:02.410555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f21aa-6e43-406f-875a-d0336887a861 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:02.436110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1084/2170] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:02.437878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ead78-f18e-47a0-ac0f-bfa832270365 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.438864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ead78-f18e-47a0-ac0f-bfa832270365 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.439690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ead78-f18e-47a0-ac0f-bfa832270365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.476109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:02.494058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-792ead78-f18e-47a0-ac0f-bfa832270365 None None] MFA Rules not processed for user `942b97c444d24165b775b34190eac8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:02.495319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-792ead78-f18e-47a0-ac0f-bfa832270365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.534324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1087/2171] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:02 2022] PUT /identity/v3/projects/ada3d8fcd577416aa83bd1d043ff3cc0/users/366fea775c414f9e92e840501fd4cf25/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:02.546263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab72df-3d0a-4493-9c8d-a03c77a8dc7d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.546581 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab72df-3d0a-4493-9c8d-a03c77a8dc7d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.546827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab72df-3d0a-4493-9c8d-a03c77a8dc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.577498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-54ab72df-3d0a-4493-9c8d-a03c77a8dc7d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:02.579057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-54ab72df-3d0a-4493-9c8d-a03c77a8dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.621196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1085/2172] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:02.621196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07cd8-c32c-4223-9424-6336fad9d4d3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.621196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07cd8-c32c-4223-9424-6336fad9d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.621196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d07cd8-c32c-4223-9424-6336fad9d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.655360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-26d07cd8-c32c-4223-9424-6336fad9d4d3 None None] MFA Rules not processed for user `366fea775c414f9e92e840501fd4cf25`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:02.656615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-26d07cd8-c32c-4223-9424-6336fad9d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.675424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1088/2173] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:02.676571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab72df-3d0a-4493-9c8d-a03c77a8dc7d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:02.678152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-54ab72df-3d0a-4493-9c8d-a03c77a8dc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.692996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab72df-3d0a-4493-9c8d-a03c77a8dc7d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:02.701262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:02.702557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.702851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.703265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.704146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:02.707636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:02.736579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1086/2174] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:02.738081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54dce-8477-4af7-9b4d-3682d7ec9355 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.738377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54dce-8477-4af7-9b4d-3682d7ec9355 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.738655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54dce-8477-4af7-9b4d-3682d7ec9355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.765223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-21d54dce-8477-4af7-9b4d-3682d7ec9355 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:02.766532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-21d54dce-8477-4af7-9b4d-3682d7ec9355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.777223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1087/2175] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:02.777223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d54dce-8477-4af7-9b4d-3682d7ec9355 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:02.787336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d54dce-8477-4af7-9b4d-3682d7ec9355 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:02.792108 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c08417-cfc0-4a71-be3e-b2f35ac0c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:02.792712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c08417-cfc0-4a71-be3e-b2f35ac0c341 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.793039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c08417-cfc0-4a71-be3e-b2f35ac0c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.793317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c08417-cfc0-4a71-be3e-b2f35ac0c341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.793950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c08417-cfc0-4a71-be3e-b2f35ac0c341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:02.795878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c08417-cfc0-4a71-be3e-b2f35ac0c341 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:02.837993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1089/2176] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:02 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:02.837993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:02.837993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:02.905177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e08ea0-95c6-4346-8638-4418087a1cac admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:02.910553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:02.911202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:02.911524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:02.911850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] PATH_INFO: `/v3/users/276a222a300c4f70a27dbefdd3a64324` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:02.916065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276a222a300c4f70a27dbefdd3a64324)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:02.916065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:02.917312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1088/2177] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:02 2022] POST /identity/v3/projects => generated 357 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:02.918052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c08417-cfc0-4a71-be3e-b2f35ac0c341 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:02.993007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c08417-cfc0-4a71-be3e-b2f35ac0c341 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:02.997506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.002192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.002192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.002192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.002192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:03.002192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.002192 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.014115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1089/2178] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:03.014936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.025377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6f940-741e-4c7a-9f21-1eabd07d7a91 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.030801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.031486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.031682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.031991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.032632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.034868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.085771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:03.222278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276a222a300c4f70a27dbefdd3a64324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:03.222278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276a222a300c4f70a27dbefdd3a64324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:03.222576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1090/2179] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:03 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:03.222576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.222576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:03.234489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966ab48-2984-4537-96eb-5dae605754b1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.241158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.241769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.242048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.242339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.242955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.244952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.297515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276a222a300c4f70a27dbefdd3a64324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:03.298280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276a222a300c4f70a27dbefdd3a64324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:03.313186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276a222a300c4f70a27dbefdd3a64324'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:03.331209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1091/2180] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:03 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:03.331209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.331209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:03.340377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1090/2181] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:02 2022] DELETE /identity/v3/users/276a222a300c4f70a27dbefdd3a64324 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:03.342365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.344726 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6c844-2bcf-47df-8f0e-953a9e62daa1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.345124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:03.410319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e100e29-3971-496c-ad23-7025c760ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.410861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100e29-3971-496c-ad23-7025c760ceaf admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.411161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100e29-3971-496c-ad23-7025c760ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.411432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100e29-3971-496c-ad23-7025c760ceaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.412619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e100e29-3971-496c-ad23-7025c760ceaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.414191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e100e29-3971-496c-ad23-7025c760ceaf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.454057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdebc873-dc92-4030-8895-f64fe57da930 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.463117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d7d66-784d-47c6-8137-d4f95adc0ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.464070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d7d66-784d-47c6-8137-d4f95adc0ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.464774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d7d66-784d-47c6-8137-d4f95adc0ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.465244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d7d66-784d-47c6-8137-d4f95adc0ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.466352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d7d66-784d-47c6-8137-d4f95adc0ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.469333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d7d66-784d-47c6-8137-d4f95adc0ea7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.488625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1091/2182] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:03.490334 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d7d66-784d-47c6-8137-d4f95adc0ea7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.503677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d7d66-784d-47c6-8137-d4f95adc0ea7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.509502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fed4-1ff5-4c8a-b951-1e050e5dc080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.510473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fed4-1ff5-4c8a-b951-1e050e5dc080 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.510831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fed4-1ff5-4c8a-b951-1e050e5dc080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.511176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3fed4-1ff5-4c8a-b951-1e050e5dc080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.512512 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3fed4-1ff5-4c8a-b951-1e050e5dc080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.514200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1092/2183] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:03 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:03.514821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3fed4-1ff5-4c8a-b951-1e050e5dc080 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.516543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e100e29-3971-496c-ad23-7025c760ceaf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.528709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1092/2184] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:03.530085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fed4-1ff5-4c8a-b951-1e050e5dc080 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.542133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3fed4-1ff5-4c8a-b951-1e050e5dc080 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.611407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e100e29-3971-496c-ad23-7025c760ceaf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.633019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdedc8-02bf-4d2a-8414-57d1b6dcecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.634138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdedc8-02bf-4d2a-8414-57d1b6dcecec admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.634561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdedc8-02bf-4d2a-8414-57d1b6dcecec admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.635119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdedc8-02bf-4d2a-8414-57d1b6dcecec admin admin] PATH_INFO: `/v3/projects/d17a30deba8d44dd8fcc11ae51fc5a25/users/1b13850a216747b6be3b4bd797d3088b/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.644165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a206-8728-43d9-9961-1937415a1ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.644165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a206-8728-43d9-9961-1937415a1ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.644165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a206-8728-43d9-9961-1937415a1ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.644165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a206-8728-43d9-9961-1937415a1ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.644986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a206-8728-43d9-9961-1937415a1ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.646893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a206-8728-43d9-9961-1937415a1ad1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.670772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdedc8-02bf-4d2a-8414-57d1b6dcecec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17a30deba8d44dd8fcc11ae51fc5a25, user_id=1b13850a216747b6be3b4bd797d3088b, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.673826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdedc8-02bf-4d2a-8414-57d1b6dcecec admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.782181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1093/2185] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:03 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:03.783195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a206-8728-43d9-9961-1937415a1ad1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.788308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1093/2186] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:03 2022] PUT /identity/v3/projects/d17a30deba8d44dd8fcc11ae51fc5a25/users/1b13850a216747b6be3b4bd797d3088b/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:03.788308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdedc8-02bf-4d2a-8414-57d1b6dcecec admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.801954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a206-8728-43d9-9961-1937415a1ad1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.864376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdedc8-02bf-4d2a-8414-57d1b6dcecec admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.869638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.878814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.878814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.878814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.878814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.878814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.888401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1094/2187] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:03.889304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:03.892345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e15df-2200-466a-ad1d-234ee85536cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.893062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e15df-2200-466a-ad1d-234ee85536cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.893256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:03.893522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e15df-2200-466a-ad1d-234ee85536cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.894085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e15df-2200-466a-ad1d-234ee85536cf admin admin] PATH_INFO: `/v3/projects/cd55d6e028144663bc2658cda45df6b6/users/be06160ace0b42e58422cb1cbd128357/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.907467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c4aa-b650-4f62-a17d-17bb55d490d1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:03.911091 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e15df-2200-466a-ad1d-234ee85536cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd55d6e028144663bc2658cda45df6b6, user_id=be06160ace0b42e58422cb1cbd128357, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.913241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:03.913878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:03.914162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:03.914302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e15df-2200-466a-ad1d-234ee85536cf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.914433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] PATH_INFO: `/v3/projects/32cd904df814490093f2dd3c20b2bf9c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:03.915700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32cd904df814490093f2dd3c20b2bf9c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:03.920873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:03.994470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:04.035108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1094/2188] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:03 2022] PUT /identity/v3/projects/cd55d6e028144663bc2658cda45df6b6/users/be06160ace0b42e58422cb1cbd128357/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:04.035975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e15df-2200-466a-ad1d-234ee85536cf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.087090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32cd904df814490093f2dd3c20b2bf9c', 'request_id': 'req-80ddba76-8b49-4a05-9666-f953fea28904'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.098173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e15df-2200-466a-ad1d-234ee85536cf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.153809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbbcb5-a412-435b-88f5-0f68fd361936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.154525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbbcb5-a412-435b-88f5-0f68fd361936 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.154809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbbcb5-a412-435b-88f5-0f68fd361936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.155086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbbcb5-a412-435b-88f5-0f68fd361936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.155754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbbcb5-a412-435b-88f5-0f68fd361936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.157361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbbcb5-a412-435b-88f5-0f68fd361936 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:04.168175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1095/2189] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:04.170517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbbcb5-a412-435b-88f5-0f68fd361936 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.179172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbbcb5-a412-435b-88f5-0f68fd361936 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.183928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c91a43-56ee-4790-bce8-3d234fc23951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.184531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91a43-56ee-4790-bce8-3d234fc23951 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.184817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91a43-56ee-4790-bce8-3d234fc23951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.185096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91a43-56ee-4790-bce8-3d234fc23951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.185737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c91a43-56ee-4790-bce8-3d234fc23951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.187328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c91a43-56ee-4790-bce8-3d234fc23951 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:04.198019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1096/2190] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:04.205455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c91a43-56ee-4790-bce8-3d234fc23951 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.209717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c91a43-56ee-4790-bce8-3d234fc23951 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.214390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c073fc-1e37-4f33-81bd-77b76f1994aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.214989 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c073fc-1e37-4f33-81bd-77b76f1994aa admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.215271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c073fc-1e37-4f33-81bd-77b76f1994aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.215550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c073fc-1e37-4f33-81bd-77b76f1994aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.216233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c073fc-1e37-4f33-81bd-77b76f1994aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.217819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c073fc-1e37-4f33-81bd-77b76f1994aa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:04.229094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32cd904df814490093f2dd3c20b2bf9c', 'request_id': 'req-80ddba76-8b49-4a05-9666-f953fea28904'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.235433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1097/2191] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:04.235433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c073fc-1e37-4f33-81bd-77b76f1994aa admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.237943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32cd904df814490093f2dd3c20b2bf9c', 'request_id': 'req-80ddba76-8b49-4a05-9666-f953fea28904'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.247170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c073fc-1e37-4f33-81bd-77b76f1994aa admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.253594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] The token cache is being invalidate because project 32cd904df814490093f2dd3c20b2bf9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:04.254081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.255046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.255167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.256180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.256626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.257076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] PATH_INFO: `/v3/projects/d17a30deba8d44dd8fcc11ae51fc5a25/users/1b13850a216747b6be3b4bd797d3088b/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.257546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1095/2192] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:03 2022] DELETE /identity/v3/projects/32cd904df814490093f2dd3c20b2bf9c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:04.260341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17a30deba8d44dd8fcc11ae51fc5a25, user_id=1b13850a216747b6be3b4bd797d3088b, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.262909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.263595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:04.264445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:04.279332 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1098/2193] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:04 2022] PUT /identity/v3/projects/d17a30deba8d44dd8fcc11ae51fc5a25/users/1b13850a216747b6be3b4bd797d3088b/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:04.279332 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.288196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:04.297950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddba76-8b49-4a05-9666-f953fea28904 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.357063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fad711-46d9-46c5-961a-2c796c0376ab admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.364630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.365301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.365582 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.366127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] PATH_INFO: `/v3/projects/cd55d6e028144663bc2658cda45df6b6/users/be06160ace0b42e58422cb1cbd128357/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.368150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd55d6e028144663bc2658cda45df6b6, user_id=be06160ace0b42e58422cb1cbd128357, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.370713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:04.381052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a3007-58fd-4697-90c0-c47b07360a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.395989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3007-58fd-4697-90c0-c47b07360a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.395989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3007-58fd-4697-90c0-c47b07360a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.395989 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3007-58fd-4697-90c0-c47b07360a16 admin admin] PATH_INFO: `/v3/projects/381be5ff2fb14f0ab908484a1e774e06/users/1ce6b3b06bff49a9ad0d465da0464e49/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.396543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1099/2194] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:04 2022] PUT /identity/v3/projects/cd55d6e028144663bc2658cda45df6b6/users/be06160ace0b42e58422cb1cbd128357/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:04.396543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.396543 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:04.401031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a3007-58fd-4697-90c0-c47b07360a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381be5ff2fb14f0ab908484a1e774e06, user_id=1ce6b3b06bff49a9ad0d465da0464e49, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.404532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a3007-58fd-4697-90c0-c47b07360a16 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:04.452619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea010c-6290-4e17-8300-8ec63cd939df admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.458457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.459144 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.459379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.459660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] PATH_INFO: `/v3/users/d48d9a58486f413681506c45609cb2c3` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.460832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48d9a58486f413681506c45609cb2c3)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.462758 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:04.487657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1096/2195] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:04 2022] PUT /identity/v3/projects/381be5ff2fb14f0ab908484a1e774e06/users/1ce6b3b06bff49a9ad0d465da0464e49/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:04.497407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41565179-a4c3-43e3-b304-579808f2b6b3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.497407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41565179-a4c3-43e3-b304-579808f2b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.497407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41565179-a4c3-43e3-b304-579808f2b6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.520386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-41565179-a4c3-43e3-b304-579808f2b6b3 None None] MFA Rules not processed for user `be06160ace0b42e58422cb1cbd128357`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:04.538099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-41565179-a4c3-43e3-b304-579808f2b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:04.576121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:04.591189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1097/2196] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:04.592364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349af42-ec7e-4912-be80-ba6bfa7c6155 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.592658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349af42-ec7e-4912-be80-ba6bfa7c6155 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.592938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349af42-ec7e-4912-be80-ba6bfa7c6155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.623051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0349af42-ec7e-4912-be80-ba6bfa7c6155 None None] MFA Rules not processed for user `1ce6b3b06bff49a9ad0d465da0464e49`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:04.624305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0349af42-ec7e-4912-be80-ba6bfa7c6155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:04.696756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1098/2197] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:04.701866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349af42-ec7e-4912-be80-ba6bfa7c6155 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.709433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48d9a58486f413681506c45609cb2c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.710195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48d9a58486f413681506c45609cb2c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.760596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48d9a58486f413681506c45609cb2c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.761348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48d9a58486f413681506c45609cb2c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.770912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349af42-ec7e-4912-be80-ba6bfa7c6155 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.775816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.776442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.776731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.777012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.778411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.778754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48d9a58486f413681506c45609cb2c3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:04.780567 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:04.807061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1100/2198] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:04 2022] DELETE /identity/v3/users/d48d9a58486f413681506c45609cb2c3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:04.807061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.807061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:04.884115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f72b0-6c6b-4247-a83b-e984bf7980f4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:04.889842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:04.891783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:04.892124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:04.892466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:04.895070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:04.907293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1099/2199] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:04 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:04.912646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:04.914995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:04.993464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:04.995259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:05.007639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1101/2200] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:05.015204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515669c-b334-4360-94b2-15f786bf775e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:05.018335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629550d0-674b-459c-a7dd-725807752d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:05.019066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629550d0-674b-459c-a7dd-725807752d1f admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.019422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629550d0-674b-459c-a7dd-725807752d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.019805 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629550d0-674b-459c-a7dd-725807752d1f admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.020689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629550d0-674b-459c-a7dd-725807752d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:05.022718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629550d0-674b-459c-a7dd-725807752d1f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:05.151575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:05.153157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:05.208012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1100/2201] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:04 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:05.208794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629550d0-674b-459c-a7dd-725807752d1f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:05.223141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629550d0-674b-459c-a7dd-725807752d1f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:05.230671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:05.233524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.233524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.233524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.233524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:05.235533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:05.274130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1101/2202] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:05.274130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:05.276633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:05.295963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05689c4-f6be-4b64-81e7-a9ba689de245 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:05.297081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5ad80-7ab2-4603-b7e9-88e195cccd6a service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:05.303368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:05.304051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.304340 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.304623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] PATH_INFO: `/v3/users/6e3eac29be1347ac8519791212346e7f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.306055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3eac29be1347ac8519791212346e7f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:05.308208 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:05.310278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:05.311926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.312423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.313609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] PATH_INFO: `/v3/projects/493f15f771a44d8e90c0b33e918f4c0c` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.315802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493f15f771a44d8e90c0b33e918f4c0c)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:05.317805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:05.540477 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493f15f771a44d8e90c0b33e918f4c0c', 'request_id': 'req-6c5a065f-35a4-495c-b006-8350f1f33db4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.541889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3eac29be1347ac8519791212346e7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.623300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493f15f771a44d8e90c0b33e918f4c0c', 'request_id': 'req-6c5a065f-35a4-495c-b006-8350f1f33db4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.630963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493f15f771a44d8e90c0b33e918f4c0c', 'request_id': 'req-6c5a065f-35a4-495c-b006-8350f1f33db4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.644205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] The token cache is being invalidate because project 493f15f771a44d8e90c0b33e918f4c0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:05.644723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.646866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:05.647504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.649174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1102/2203] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:05 2022] DELETE /identity/v3/projects/493f15f771a44d8e90c0b33e918f4c0c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:05.649990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:05.654997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:05.714521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3eac29be1347ac8519791212346e7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.715239 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3eac29be1347ac8519791212346e7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.729215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a065f-35a4-495c-b006-8350f1f33db4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:05.729403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3eac29be1347ac8519791212346e7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.730247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3eac29be1347ac8519791212346e7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:05.731711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724428c7-0bce-4229-b2ff-b9913021ed30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:05.732411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724428c7-0bce-4229-b2ff-b9913021ed30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.732692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724428c7-0bce-4229-b2ff-b9913021ed30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.733103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724428c7-0bce-4229-b2ff-b9913021ed30 admin admin] PATH_INFO: `/v3/projects/9c41c71a6b3f49cdbcdd933bb8532219/users/76d7bf531d4d4bc8a6438ec7f7240a7f/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.744815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1102/2204] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:05 2022] DELETE /identity/v3/users/6e3eac29be1347ac8519791212346e7f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:05.746068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:05.748147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:05.752116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724428c7-0bce-4229-b2ff-b9913021ed30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c41c71a6b3f49cdbcdd933bb8532219, user_id=76d7bf531d4d4bc8a6438ec7f7240a7f, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:05.753856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724428c7-0bce-4229-b2ff-b9913021ed30 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:05.812688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97e1ce-ef61-43e6-a492-a7830091dd9b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:05.817932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcf2fc-b860-471d-95c5-c5cb7d95c44b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:05.818727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf2fc-b860-471d-95c5-c5cb7d95c44b service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.819102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf2fc-b860-471d-95c5-c5cb7d95c44b service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.819489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcf2fc-b860-471d-95c5-c5cb7d95c44b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.821475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-77dcf2fc-b860-471d-95c5-c5cb7d95c44b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:05.866243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1103/2205] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:05 2022] PUT /identity/v3/projects/9c41c71a6b3f49cdbcdd933bb8532219/users/76d7bf531d4d4bc8a6438ec7f7240a7f/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:05.868222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dc1f5-df3b-4efa-bb78-0c30b860ebbd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.868708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dc1f5-df3b-4efa-bb78-0c30b860ebbd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.869218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dc1f5-df3b-4efa-bb78-0c30b860ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.890307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcf2fc-b860-471d-95c5-c5cb7d95c44b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:05.891234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-073dc1f5-df3b-4efa-bb78-0c30b860ebbd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:05.891992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcf2fc-b860-471d-95c5-c5cb7d95c44b service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:05.895212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-073dc1f5-df3b-4efa-bb78-0c30b860ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:05.902403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1103/2206] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:05.903821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b495-344d-4c59-95a4-5ff8b76f9a3e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.904256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b495-344d-4c59-95a4-5ff8b76f9a3e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.904744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b495-344d-4c59-95a4-5ff8b76f9a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.926602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9338b495-344d-4c59-95a4-5ff8b76f9a3e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:05.927868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9338b495-344d-4c59-95a4-5ff8b76f9a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:05.957409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1104/2207] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:05.958420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dc1f5-df3b-4efa-bb78-0c30b860ebbd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:05.959745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-073dc1f5-df3b-4efa-bb78-0c30b860ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:05.979527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dc1f5-df3b-4efa-bb78-0c30b860ebbd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:05.979527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e0cd-881d-495e-99c0-a03a8a5325ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:05.979527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e0cd-881d-495e-99c0-a03a8a5325ca admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.979527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e0cd-881d-495e-99c0-a03a8a5325ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.980012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716e0cd-881d-495e-99c0-a03a8a5325ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.980012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e0cd-881d-495e-99c0-a03a8a5325ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:05.981380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716e0cd-881d-495e-99c0-a03a8a5325ca admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:05.991177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1104/2208] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:05.992449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc93c5-98be-4a3c-a8e4-fcc6888e09c2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:05.992738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc93c5-98be-4a3c-a8e4-fcc6888e09c2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:05.996299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc93c5-98be-4a3c-a8e4-fcc6888e09c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:05.996515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1105/2209] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:05.996910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e0cd-881d-495e-99c0-a03a8a5325ca admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.008184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716e0cd-881d-495e-99c0-a03a8a5325ca admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.014796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada664-d464-4fca-804a-6dbbda1a1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.014967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e8cc93c5-98be-4a3c-a8e4-fcc6888e09c2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:06.015516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada664-d464-4fca-804a-6dbbda1a1f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.015834 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada664-d464-4fca-804a-6dbbda1a1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.016092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e8cc93c5-98be-4a3c-a8e4-fcc6888e09c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:06.016204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dada664-d464-4fca-804a-6dbbda1a1f83 admin admin] PATH_INFO: `/v3/projects/9c41c71a6b3f49cdbcdd933bb8532219/users/76d7bf531d4d4bc8a6438ec7f7240a7f/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.018847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada664-d464-4fca-804a-6dbbda1a1f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c41c71a6b3f49cdbcdd933bb8532219, user_id=76d7bf531d4d4bc8a6438ec7f7240a7f, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.021767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dada664-d464-4fca-804a-6dbbda1a1f83 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.028089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1105/2210] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:06.029705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc93c5-98be-4a3c-a8e4-fcc6888e09c2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.031185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e8cc93c5-98be-4a3c-a8e4-fcc6888e09c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:06.035840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1106/2211] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:05 2022] PUT /identity/v3/projects/9c41c71a6b3f49cdbcdd933bb8532219/users/76d7bf531d4d4bc8a6438ec7f7240a7f/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:06.036641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada664-d464-4fca-804a-6dbbda1a1f83 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.094564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc93c5-98be-4a3c-a8e4-fcc6888e09c2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.124640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dada664-d464-4fca-804a-6dbbda1a1f83 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.130768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4bb85-273a-447e-a026-de37026475ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.131389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4bb85-273a-447e-a026-de37026475ca admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.131669 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4bb85-273a-447e-a026-de37026475ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.131987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4bb85-273a-447e-a026-de37026475ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.132640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4bb85-273a-447e-a026-de37026475ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:06.132951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4bb85-273a-447e-a026-de37026475ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.134541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4bb85-273a-447e-a026-de37026475ca admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.157870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1107/2212] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:06.160259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdc2c-e213-4d11-81db-4f9d9d16dc53 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.161064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdc2c-e213-4d11-81db-4f9d9d16dc53 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.161507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdc2c-e213-4d11-81db-4f9d9d16dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.165625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead9c0-8139-40a3-985b-bbaa194c3f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.166256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead9c0-8139-40a3-985b-bbaa194c3f13 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.171831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead9c0-8139-40a3-985b-bbaa194c3f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.172207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fead9c0-8139-40a3-985b-bbaa194c3f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.187566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead9c0-8139-40a3-985b-bbaa194c3f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.190486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fead9c0-8139-40a3-985b-bbaa194c3f13 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.206856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9f0bdc2c-e213-4d11-81db-4f9d9d16dc53 None None] MFA Rules not processed for user `76d7bf531d4d4bc8a6438ec7f7240a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:06.208397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f0bdc2c-e213-4d11-81db-4f9d9d16dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:06.211241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1106/2213] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:06.212186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead9c0-8139-40a3-985b-bbaa194c3f13 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.229254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fead9c0-8139-40a3-985b-bbaa194c3f13 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.229775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49862d3f-f4d1-4b4e-8515-49f906af7571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.230422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49862d3f-f4d1-4b4e-8515-49f906af7571 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.230772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49862d3f-f4d1-4b4e-8515-49f906af7571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.231115 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49862d3f-f4d1-4b4e-8515-49f906af7571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.231868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49862d3f-f4d1-4b4e-8515-49f906af7571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.234092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49862d3f-f4d1-4b4e-8515-49f906af7571 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.333452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1107/2214] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:06 2022] POST /identity/v3/projects => generated 361 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:06.335562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1f644-d5de-46fe-a784-ce62878c29f1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.335997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1f644-d5de-46fe-a784-ce62878c29f1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.336750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1f644-d5de-46fe-a784-ce62878c29f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.371993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1108/2215] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:06.372881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bdc2c-e213-4d11-81db-4f9d9d16dc53 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.382315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-57f1f644-d5de-46fe-a784-ce62878c29f1 None None] MFA Rules not processed for user `1b13850a216747b6be3b4bd797d3088b`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:06.383791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-57f1f644-d5de-46fe-a784-ce62878c29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:06.399073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bdc2c-e213-4d11-81db-4f9d9d16dc53 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.483952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1108/2216] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:06.484952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1f644-d5de-46fe-a784-ce62878c29f1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.535219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a22c8b-370f-4c91-9a03-c63200fe627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.537221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22c8b-370f-4c91-9a03-c63200fe627b admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.537878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22c8b-370f-4c91-9a03-c63200fe627b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.538416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22c8b-370f-4c91-9a03-c63200fe627b admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.538896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a22c8b-370f-4c91-9a03-c63200fe627b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.541101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a22c8b-370f-4c91-9a03-c63200fe627b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.563750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1f644-d5de-46fe-a784-ce62878c29f1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.568374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a7402-3e35-4c70-a848-4c95d05cb0be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.569330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a7402-3e35-4c70-a848-4c95d05cb0be service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.569714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a7402-3e35-4c70-a848-4c95d05cb0be service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.570331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a7402-3e35-4c70-a848-4c95d05cb0be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.645196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1109/2217] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:06 2022] POST /identity/v3/users => generated 281 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:06.650890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c6040-b3e1-459e-979e-f075020ff0fb None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.650890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c6040-b3e1-459e-979e-f075020ff0fb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.650890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c6040-b3e1-459e-979e-f075020ff0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.671641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1b2c6040-b3e1-459e-979e-f075020ff0fb None None] MFA Rules not processed for user `942b97c444d24165b775b34190eac8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:06.674196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1b2c6040-b3e1-459e-979e-f075020ff0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:06.695876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a7402-3e35-4c70-a848-4c95d05cb0be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.697495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a7402-3e35-4c70-a848-4c95d05cb0be service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.722668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1109/2218] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:06.724042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a7402-3e35-4c70-a848-4c95d05cb0be service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.737874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a7402-3e35-4c70-a848-4c95d05cb0be service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.744976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80eb97-e288-4f43-a72a-091d0b5d185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80eb97-e288-4f43-a72a-091d0b5d185f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80eb97-e288-4f43-a72a-091d0b5d185f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80eb97-e288-4f43-a72a-091d0b5d185f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.749155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80eb97-e288-4f43-a72a-091d0b5d185f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.749506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1110/2219] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:06.753280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80eb97-e288-4f43-a72a-091d0b5d185f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.765975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c6040-b3e1-459e-979e-f075020ff0fb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.773372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1b2c6040-b3e1-459e-979e-f075020ff0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:06.773788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1110/2220] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:06.785126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80eb97-e288-4f43-a72a-091d0b5d185f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.803718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80eb97-e288-4f43-a72a-091d0b5d185f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.818822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b961-b617-42ea-a9b9-f4f30330100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.819460 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b961-b617-42ea-a9b9-f4f30330100b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.819771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b961-b617-42ea-a9b9-f4f30330100b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.820084 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b961-b617-42ea-a9b9-f4f30330100b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.820755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396b961-b617-42ea-a9b9-f4f30330100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.825722 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396b961-b617-42ea-a9b9-f4f30330100b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.840911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1111/2221] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:06.845055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b961-b617-42ea-a9b9-f4f30330100b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.864160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b961-b617-42ea-a9b9-f4f30330100b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.868462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a20dc-9ddc-49f9-aa4b-69c5b8d082d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.869544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a20dc-9ddc-49f9-aa4b-69c5b8d082d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.870146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a20dc-9ddc-49f9-aa4b-69c5b8d082d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.870503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a20dc-9ddc-49f9-aa4b-69c5b8d082d1 admin admin] PATH_INFO: `/v3/projects/b59fcc0ddc9d41d48067e0c9350396aa/users/209329d8c4354ebc8943f18270bf16ba/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.910681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c6040-b3e1-459e-979e-f075020ff0fb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.911656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.912553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.913326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.913326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.921700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:06.928628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a20dc-9ddc-49f9-aa4b-69c5b8d082d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59fcc0ddc9d41d48067e0c9350396aa, user_id=209329d8c4354ebc8943f18270bf16ba, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.932000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a20dc-9ddc-49f9-aa4b-69c5b8d082d1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.941448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.943464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:06.953927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1111/2222] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:06.965018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:06.966540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:06.981570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069c303-af2d-4e8d-807b-e77db6408e9e service nova] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:06.988395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:06.989050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:06.989338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:06.989615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] PATH_INFO: `/v3/projects/13474245b33e49bfad5d827e2b178e91` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:06.990741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13474245b33e49bfad5d827e2b178e91)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:06.992666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:07.058019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1112/2223] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:06 2022] PUT /identity/v3/projects/b59fcc0ddc9d41d48067e0c9350396aa/users/209329d8c4354ebc8943f18270bf16ba/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:07.073060 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fb0d7-83fd-4edb-9044-6e45efbabec3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:07.073353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fb0d7-83fd-4edb-9044-6e45efbabec3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:07.073632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fb0d7-83fd-4edb-9044-6e45efbabec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:07.104502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-2f6fb0d7-83fd-4edb-9044-6e45efbabec3 None None] MFA Rules not processed for user `209329d8c4354ebc8943f18270bf16ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:07.106426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2f6fb0d7-83fd-4edb-9044-6e45efbabec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:07.189291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13474245b33e49bfad5d827e2b178e91', 'request_id': 'req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:07.213622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1113/2224] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:07.224602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fb0d7-83fd-4edb-9044-6e45efbabec3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:07.295400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fb0d7-83fd-4edb-9044-6e45efbabec3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:07.313575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13474245b33e49bfad5d827e2b178e91', 'request_id': 'req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:07.322628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13474245b33e49bfad5d827e2b178e91', 'request_id': 'req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:07.335670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] The token cache is being invalidate because project 13474245b33e49bfad5d827e2b178e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:07.336191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:07.337183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f7a73d02-0ea8-4850-b73f-57594b6d3ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:07.342677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1112/2225] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:06 2022] DELETE /identity/v3/projects/13474245b33e49bfad5d827e2b178e91 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:07.344241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c110-e532-45f7-b9ed-5cc5408650d7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:07.344807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c110-e532-45f7-b9ed-5cc5408650d7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:07.345101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c110-e532-45f7-b9ed-5cc5408650d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-d5c3c110-e532-45f7-b9ed-5cc5408650d7 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:19:07.354761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:07.355760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:19:07.357698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1113/2226] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:19:07 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:19:07.358557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c110-e532-45f7-b9ed-5cc5408650d7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:07.360461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d5c3c110-e532-45f7-b9ed-5cc5408650d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:07.382738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:07.383518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:07.384016 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:07.384419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:07.385128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:07.387897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:07.466975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c110-e532-45f7-b9ed-5cc5408650d7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:07.472131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:07.472830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:07.473114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:07.473391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] PATH_INFO: `/v3/users/f3e9ae13e7494191b27bbcc753aba037` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:07.474577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e9ae13e7494191b27bbcc753aba037)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:07.476521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:08.870301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1114/2227] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:07 2022] POST /identity/v3/projects => generated 365 bytes in 1646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:08.874487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:08.876611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:08.954411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a134b-9309-479a-8f3a-bff268155aa0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:08.956484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:08.961638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806f9c2-cb29-4b6d-a688-eda26220da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:08.962396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806f9c2-cb29-4b6d-a688-eda26220da81 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:08.962679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806f9c2-cb29-4b6d-a688-eda26220da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:08.962950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806f9c2-cb29-4b6d-a688-eda26220da81 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:08.963577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806f9c2-cb29-4b6d-a688-eda26220da81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:08.965855 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806f9c2-cb29-4b6d-a688-eda26220da81 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:09.017653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e9ae13e7494191b27bbcc753aba037'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:09.018793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e9ae13e7494191b27bbcc753aba037'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:09.073044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1115/2228] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:08 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:09.073044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a907ff-212c-4c6f-bebc-8db2a6af2a81 None None] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.073044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a907ff-212c-4c6f-bebc-8db2a6af2a81 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.073044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a907ff-212c-4c6f-bebc-8db2a6af2a81 None None] PATH_INFO: `/` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.073684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1116/2229] 10.222.0.82 () {54 vars in 921 bytes} [Mon Aug 29 19:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 19:19:09.074435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a907ff-212c-4c6f-bebc-8db2a6af2a81 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:09.076178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-70a907ff-212c-4c6f-bebc-8db2a6af2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:09.095749 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a907ff-212c-4c6f-bebc-8db2a6af2a81 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:09.101215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a49414-01f1-4801-b93d-7c7f2c8a32e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:09.102073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49414-01f1-4801-b93d-7c7f2c8a32e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.102359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49414-01f1-4801-b93d-7c7f2c8a32e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.102634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49414-01f1-4801-b93d-7c7f2c8a32e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.103358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a49414-01f1-4801-b93d-7c7f2c8a32e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:09.105059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a49414-01f1-4801-b93d-7c7f2c8a32e2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:09.116199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1117/2230] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:09.117570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483cda7-a244-426b-9d71-3f0473a26db5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.117866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483cda7-a244-426b-9d71-3f0473a26db5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.118150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483cda7-a244-426b-9d71-3f0473a26db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.125676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e9ae13e7494191b27bbcc753aba037'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:09.126305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e9ae13e7494191b27bbcc753aba037'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:09.138914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f483cda7-a244-426b-9d71-3f0473a26db5 None None] MFA Rules not processed for user `e02a03585caf46fdb09b4a2fdde91a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:09.140179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f483cda7-a244-426b-9d71-3f0473a26db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:09.142777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e9ae13e7494191b27bbcc753aba037'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:09.160205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1114/2231] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:07 2022] DELETE /identity/v3/users/f3e9ae13e7494191b27bbcc753aba037 => generated 0 bytes in 1798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:09.160205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:09.236836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf437c-8e46-4a7b-b64c-85b9e3ac52b4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:09.246320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8279-f5be-43ff-b9eb-7bc3d6618d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:09.247598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8279-f5be-43ff-b9eb-7bc3d6618d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.247598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8279-f5be-43ff-b9eb-7bc3d6618d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.247809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a8279-f5be-43ff-b9eb-7bc3d6618d94 admin admin] PATH_INFO: `/v3/projects/bcebb90b2d164739bc1a13452317f02d/users/b367a58923ae485f8f7ae18b587f3a66/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.265481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1118/2232] 10.222.0.82 () {58 vars in 1018 bytes} [Mon Aug 29 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:09.266639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a8279-f5be-43ff-b9eb-7bc3d6618d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcebb90b2d164739bc1a13452317f02d, user_id=b367a58923ae485f8f7ae18b587f3a66, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:09.269109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a8279-f5be-43ff-b9eb-7bc3d6618d94 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:09.280236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483cda7-a244-426b-9d71-3f0473a26db5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:09.283462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f483cda7-a244-426b-9d71-3f0473a26db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:09.295991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483cda7-a244-426b-9d71-3f0473a26db5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:09.375200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f092e21-e414-44a9-b372-a11dbdf478f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:09.375746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092e21-e414-44a9-b372-a11dbdf478f5 service nova] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.376051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092e21-e414-44a9-b372-a11dbdf478f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.376330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092e21-e414-44a9-b372-a11dbdf478f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.385949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f092e21-e414-44a9-b372-a11dbdf478f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:09.387681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f092e21-e414-44a9-b372-a11dbdf478f5 service nova] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:09.399767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1119/2233] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:09.403206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1115/2234] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:09 2022] PUT /identity/v3/projects/bcebb90b2d164739bc1a13452317f02d/users/b367a58923ae485f8f7ae18b587f3a66/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:09.404348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f092e21-e414-44a9-b372-a11dbdf478f5 service nova] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:09.415766 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f092e21-e414-44a9-b372-a11dbdf478f5 service nova] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:09.430361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:09.495574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84371af-cb3c-4552-b55e-31f0fe1fe12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:09.496670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84371af-cb3c-4552-b55e-31f0fe1fe12c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.496670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84371af-cb3c-4552-b55e-31f0fe1fe12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.496862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84371af-cb3c-4552-b55e-31f0fe1fe12c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.497502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84371af-cb3c-4552-b55e-31f0fe1fe12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:09.499114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84371af-cb3c-4552-b55e-31f0fe1fe12c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:09.513573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1120/2235] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:09.515128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8279-f5be-43ff-b9eb-7bc3d6618d94 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:09.526500 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a8279-f5be-43ff-b9eb-7bc3d6618d94 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:09.531809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:09.532480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.532774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.533031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] PATH_INFO: `/v3/projects/bcebb90b2d164739bc1a13452317f02d/users/b367a58923ae485f8f7ae18b587f3a66/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.537233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcebb90b2d164739bc1a13452317f02d, user_id=b367a58923ae485f8f7ae18b587f3a66, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:09.542299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:09.554222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1116/2236] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:09 2022] PUT /identity/v3/projects/bcebb90b2d164739bc1a13452317f02d/users/b367a58923ae485f8f7ae18b587f3a66/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:09.565546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472ef4-2c26-4382-9e29-d78e2f68e854 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.569282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472ef4-2c26-4382-9e29-d78e2f68e854 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.569282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472ef4-2c26-4382-9e29-d78e2f68e854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.619644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-93472ef4-2c26-4382-9e29-d78e2f68e854 None None] MFA Rules not processed for user `b367a58923ae485f8f7ae18b587f3a66`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:09.621184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-93472ef4-2c26-4382-9e29-d78e2f68e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:09.689253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:09.692724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:09.786169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1121/2237] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:09.834056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93472ef4-2c26-4382-9e29-d78e2f68e854 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:09.836512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-93472ef4-2c26-4382-9e29-d78e2f68e854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:09.871749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0387f-7938-4772-8a59-1927883da355 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:09.876877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:09.877731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.878291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.878988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] PATH_INFO: `/v3/projects/acfcdf89e7214663a9c675a7ced1f715` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.881028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=acfcdf89e7214663a9c675a7ced1f715)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:09.883227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:09.945798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93472ef4-2c26-4382-9e29-d78e2f68e854 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:09.951483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d7bf531d4d4bc8a6438ec7f7240a7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c41c71a6b3f49cdbcdd933bb8532219', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:09.952501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:09.953593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:09.953964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:09.954781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:09.955181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:09.957844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:09.975332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1122/2238] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:19:09.986254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:10.006407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b6b1a-85e5-4e69-804f-6ad08897437c tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:10.016073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d7bf531d4d4bc8a6438ec7f7240a7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c41c71a6b3f49cdbcdd933bb8532219', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:10.017299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.017849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.018437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.020283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:10.023963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:10.071914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acfcdf89e7214663a9c675a7ced1f715', 'request_id': 'req-60d693c9-1832-40a2-9842-735c0de4d6ce'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.135739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1123/2239] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:09 2022] POST /identity/v3/projects => generated 354 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:10.136908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:10.138767 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:10.177418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acfcdf89e7214663a9c675a7ced1f715', 'request_id': 'req-60d693c9-1832-40a2-9842-735c0de4d6ce'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.187642 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acfcdf89e7214663a9c675a7ced1f715', 'request_id': 'req-60d693c9-1832-40a2-9842-735c0de4d6ce'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.206384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] The token cache is being invalidate because project acfcdf89e7214663a9c675a7ced1f715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:10.206384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.208368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.208860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb8063c-bd34-48b9-847a-0f082e85662e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:10.214608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1117/2240] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:09 2022] DELETE /identity/v3/projects/acfcdf89e7214663a9c675a7ced1f715 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:10.214608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:10.222326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:10.222420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11a4c2-9398-40d1-aed0-59042458c415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:10.222420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11a4c2-9398-40d1-aed0-59042458c415 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.222420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11a4c2-9398-40d1-aed0-59042458c415 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.222420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11a4c2-9398-40d1-aed0-59042458c415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.222739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9e11a4c2-9398-40d1-aed0-59042458c415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:10.308557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11a4c2-9398-40d1-aed0-59042458c415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:10.310908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11a4c2-9398-40d1-aed0-59042458c415 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:10.313032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d693c9-1832-40a2-9842-735c0de4d6ce admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:10.323867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1124/2241] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:10.325522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28496-1960-48ff-acd3-fc0cdf17000c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.331123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28496-1960-48ff-acd3-fc0cdf17000c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.331123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a28496-1960-48ff-acd3-fc0cdf17000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.355182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-35a28496-1960-48ff-acd3-fc0cdf17000c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:10.356666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-35a28496-1960-48ff-acd3-fc0cdf17000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:10.401848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d8a3a-a5c5-40cb-a1f2-b1090b7a578e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d7bf531d4d4bc8a6438ec7f7240a7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c41c71a6b3f49cdbcdd933bb8532219', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:10.402991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8a3a-a5c5-40cb-a1f2-b1090b7a578e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.403566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8a3a-a5c5-40cb-a1f2-b1090b7a578e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.404521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d8a3a-a5c5-40cb-a1f2-b1090b7a578e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.405609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d8a3a-a5c5-40cb-a1f2-b1090b7a578e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:10.406360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d8a3a-a5c5-40cb-a1f2-b1090b7a578e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:10.410213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d8a3a-a5c5-40cb-a1f2-b1090b7a578e tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:10.428714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1118/2242] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:10.443760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1125/2243] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:10.454275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ed04-c822-48d1-9936-4125d5596e4c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.454683 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ed04-c822-48d1-9936-4125d5596e4c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.455047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973ed04-c822-48d1-9936-4125d5596e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.475113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9973ed04-c822-48d1-9936-4125d5596e4c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:10.478569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9973ed04-c822-48d1-9936-4125d5596e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:10.484743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1119/2244] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:10.489885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a28496-1960-48ff-acd3-fc0cdf17000c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:10.499483 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a28496-1960-48ff-acd3-fc0cdf17000c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:10.504952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:10.505544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.505823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.506095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.506739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:10.507130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:10.508713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:10.524592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1126/2245] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:10.525925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973ed04-c822-48d1-9936-4125d5596e4c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:10.535335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973ed04-c822-48d1-9936-4125d5596e4c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:10.545182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa2d01-db16-4006-8769-f2fa3d52dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:10.546049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2d01-db16-4006-8769-f2fa3d52dbbb admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.546497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2d01-db16-4006-8769-f2fa3d52dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.546965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa2d01-db16-4006-8769-f2fa3d52dbbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.547602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa2d01-db16-4006-8769-f2fa3d52dbbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:10.549676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa2d01-db16-4006-8769-f2fa3d52dbbb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:10.614586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:10.626925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777a2e8-b3e1-45d8-9719-ccbf427ae522 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:10.632562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76d7bf531d4d4bc8a6438ec7f7240a7f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c41c71a6b3f49cdbcdd933bb8532219', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:10.633197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.633632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.633966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] PATH_INFO: `/v3/projects/1cc3bd839d7043838c06a01f0a16b916` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.635289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1cc3bd839d7043838c06a01f0a16b916)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:10.637260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:10.675042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1120/2246] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:10 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:10.680011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa2d01-db16-4006-8769-f2fa3d52dbbb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:10.764484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc3bd839d7043838c06a01f0a16b916', 'request_id': 'req-bed8ea92-5371-4e13-aed9-c814a043c9f1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.768709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa2d01-db16-4006-8769-f2fa3d52dbbb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:10.840717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94580fdd-8a4b-4f90-b3e1-ad7e38725cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:10.841461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94580fdd-8a4b-4f90-b3e1-ad7e38725cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:10.841744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94580fdd-8a4b-4f90-b3e1-ad7e38725cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:10.842016 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94580fdd-8a4b-4f90-b3e1-ad7e38725cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:10.842650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94580fdd-8a4b-4f90-b3e1-ad7e38725cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:10.844828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94580fdd-8a4b-4f90-b3e1-ad7e38725cd0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:10.884938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc3bd839d7043838c06a01f0a16b916', 'request_id': 'req-bed8ea92-5371-4e13-aed9-c814a043c9f1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.893135 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc3bd839d7043838c06a01f0a16b916', 'request_id': 'req-bed8ea92-5371-4e13-aed9-c814a043c9f1'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.903835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] The token cache is being invalidate because project 1cc3bd839d7043838c06a01f0a16b916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:10.904128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.904801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:10.906301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1127/2247] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:10 2022] DELETE /identity/v3/projects/1cc3bd839d7043838c06a01f0a16b916 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:11.012056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1121/2248] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:10 2022] POST /identity/v3/users => generated 294 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:11.012911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:11.014581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:11.030328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ea92-5371-4e13-aed9-c814a043c9f1 tempest-VolumeQuotaClassesTest-1727650357 tempest-VolumeQuotaClassesTest-1727650357-project-admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:11.035835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf722312-16f9-4f79-8b6a-7640a42d9701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:11.036459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722312-16f9-4f79-8b6a-7640a42d9701 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.036718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722312-16f9-4f79-8b6a-7640a42d9701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.036987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf722312-16f9-4f79-8b6a-7640a42d9701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.037628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf722312-16f9-4f79-8b6a-7640a42d9701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:11.039271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf722312-16f9-4f79-8b6a-7640a42d9701 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:11.059800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1128/2249] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:11.059942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94580fdd-8a4b-4f90-b3e1-ad7e38725cd0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:11.070504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94580fdd-8a4b-4f90-b3e1-ad7e38725cd0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:11.077008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd17480-77a1-410b-bece-4ed4cb55adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:11.077663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd17480-77a1-410b-bece-4ed4cb55adb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.077902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd17480-77a1-410b-bece-4ed4cb55adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.078257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd17480-77a1-410b-bece-4ed4cb55adb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.079253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd17480-77a1-410b-bece-4ed4cb55adb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:11.081018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd17480-77a1-410b-bece-4ed4cb55adb4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:11.123766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1122/2250] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:11.135952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf722312-16f9-4f79-8b6a-7640a42d9701 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:11.146954 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf722312-16f9-4f79-8b6a-7640a42d9701 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:11.152231 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f04aa4-75ca-470e-891d-803ddf196ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:11.152910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f04aa4-75ca-470e-891d-803ddf196ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.153200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f04aa4-75ca-470e-891d-803ddf196ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.153479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f04aa4-75ca-470e-891d-803ddf196ce0 admin admin] PATH_INFO: `/v3/projects/687f49568b2742d6adcaf630c1f9bf68/users/99a47d0328d340e882dcff893716c89d/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.169333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f04aa4-75ca-470e-891d-803ddf196ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687f49568b2742d6adcaf630c1f9bf68, user_id=99a47d0328d340e882dcff893716c89d, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:11.172054 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f04aa4-75ca-470e-891d-803ddf196ce0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:11.270744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1129/2251] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:11 2022] PUT /identity/v3/projects/687f49568b2742d6adcaf630c1f9bf68/users/99a47d0328d340e882dcff893716c89d/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:11.273233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129baee7-9d41-4a2c-9313-876246594e71 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.273520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129baee7-9d41-4a2c-9313-876246594e71 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.273820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129baee7-9d41-4a2c-9313-876246594e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.313171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-129baee7-9d41-4a2c-9313-876246594e71 None None] MFA Rules not processed for user `99a47d0328d340e882dcff893716c89d`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:11.314464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-129baee7-9d41-4a2c-9313-876246594e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:11.389736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1123/2252] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:11.394765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f04aa4-75ca-470e-891d-803ddf196ce0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:11.460320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f04aa4-75ca-470e-891d-803ddf196ce0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:11.479258 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed1257-90ee-4fd4-a787-99c1a99e28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:11.480092 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed1257-90ee-4fd4-a787-99c1a99e28c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.480375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed1257-90ee-4fd4-a787-99c1a99e28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.480651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aed1257-90ee-4fd4-a787-99c1a99e28c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.481322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed1257-90ee-4fd4-a787-99c1a99e28c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:11.483596 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aed1257-90ee-4fd4-a787-99c1a99e28c1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:11.526181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129baee7-9d41-4a2c-9313-876246594e71 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:11.527523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-129baee7-9d41-4a2c-9313-876246594e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:11.592024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129baee7-9d41-4a2c-9313-876246594e71 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:11.595998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:11.596690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.597786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.597952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.601399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:11.608105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1130/2253] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:11 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:11.612169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed1257-90ee-4fd4-a787-99c1a99e28c1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:11.696340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:11.697784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:11.709880 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aed1257-90ee-4fd4-a787-99c1a99e28c1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:11.710117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1124/2254] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:11.715228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f1d24-6d00-471b-8212-306f454c7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:11.716027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f1d24-6d00-471b-8212-306f454c7be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.716315 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f1d24-6d00-471b-8212-306f454c7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.718697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f1d24-6d00-471b-8212-306f454c7be0 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.718697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f1d24-6d00-471b-8212-306f454c7be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:11.719332 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f1d24-6d00-471b-8212-306f454c7be0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:11.828935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1131/2255] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:11 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:11.833156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:11.844369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899ab76-9de9-4c15-9e11-18ef0f1c8bd1 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:11.853638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acac8b-0841-4dc7-a5e6-22a9eb4e004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:11.854299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acac8b-0841-4dc7-a5e6-22a9eb4e004b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.854656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acac8b-0841-4dc7-a5e6-22a9eb4e004b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.854930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acac8b-0841-4dc7-a5e6-22a9eb4e004b admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.855761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acac8b-0841-4dc7-a5e6-22a9eb4e004b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:11.857518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acac8b-0841-4dc7-a5e6-22a9eb4e004b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:11.869605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1125/2256] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:11.873256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f1d24-6d00-471b-8212-306f454c7be0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:11.888430 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f1d24-6d00-471b-8212-306f454c7be0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:11.895049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f0023-e29f-410e-8454-03236be25c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:11.900181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f0023-e29f-410e-8454-03236be25c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:11.900181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f0023-e29f-410e-8454-03236be25c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:11.900181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f0023-e29f-410e-8454-03236be25c1c admin admin] PATH_INFO: `/v3/projects/7715b6e760264c21b1d2e527f3238495/users/808b1cd3e41b4ec687e448952412437a/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:11.916627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f0023-e29f-410e-8454-03236be25c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7715b6e760264c21b1d2e527f3238495, user_id=808b1cd3e41b4ec687e448952412437a, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:11.919323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f0023-e29f-410e-8454-03236be25c1c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:12.067651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1132/2257] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:11 2022] PUT /identity/v3/projects/7715b6e760264c21b1d2e527f3238495/users/808b1cd3e41b4ec687e448952412437a/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:12.074849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acac8b-0841-4dc7-a5e6-22a9eb4e004b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:12.084769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acac8b-0841-4dc7-a5e6-22a9eb4e004b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:12.149905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:12.154295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:12.154936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:12.155285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:12.155587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:12.156307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:12.157888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:12.168833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1126/2258] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:12.173256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f0023-e29f-410e-8454-03236be25c1c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:12.185121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f0023-e29f-410e-8454-03236be25c1c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:12.191517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9b107-a6dc-4ea6-9e12-0459e1098cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:12.192244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b107-a6dc-4ea6-9e12-0459e1098cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:12.192708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b107-a6dc-4ea6-9e12-0459e1098cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:12.192994 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9b107-a6dc-4ea6-9e12-0459e1098cbc admin admin] PATH_INFO: `/v3/projects/7715b6e760264c21b1d2e527f3238495/users/808b1cd3e41b4ec687e448952412437a/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:12.195055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9b107-a6dc-4ea6-9e12-0459e1098cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7715b6e760264c21b1d2e527f3238495, user_id=808b1cd3e41b4ec687e448952412437a, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:12.198155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9b107-a6dc-4ea6-9e12-0459e1098cbc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:12.215783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1133/2259] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:12 2022] PUT /identity/v3/projects/7715b6e760264c21b1d2e527f3238495/users/808b1cd3e41b4ec687e448952412437a/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:12.229364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:12.231325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:12.233432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454377c8-0312-4ed7-ae7b-9702b23ce3b3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:12.233727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454377c8-0312-4ed7-ae7b-9702b23ce3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:12.234011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454377c8-0312-4ed7-ae7b-9702b23ce3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:12.249285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4875698b-650d-4337-ac68-be44b4bdd226 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:12.267356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-454377c8-0312-4ed7-ae7b-9702b23ce3b3 None None] MFA Rules not processed for user `808b1cd3e41b4ec687e448952412437a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:12.268757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-454377c8-0312-4ed7-ae7b-9702b23ce3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:12.341936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:12.342685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:12.343076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:12.343378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] PATH_INFO: `/v3/users/1ce6b3b06bff49a9ad0d465da0464e49` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:12.344596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce6b3b06bff49a9ad0d465da0464e49)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:12.346644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:12.357041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1134/2260] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:12.464251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454377c8-0312-4ed7-ae7b-9702b23ce3b3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:12.472458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-454377c8-0312-4ed7-ae7b-9702b23ce3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:12.510289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:12.576894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454377c8-0312-4ed7-ae7b-9702b23ce3b3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:12.580851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:12.581974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:12.582440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:12.582859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:12.583126 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce6b3b06bff49a9ad0d465da0464e49'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:12.583913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce6b3b06bff49a9ad0d465da0464e49'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:12.592048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:12.599638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:12.601316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:12.626158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1135/2261] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:12.646303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:12.647937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:12.664468 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739134c-9765-4275-888a-fc788ce10907 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:12.670022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:12.670782 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:12.671140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:12.671509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] PATH_INFO: `/v3/users/99a47d0328d340e882dcff893716c89d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:12.672834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a47d0328d340e882dcff893716c89d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:12.674949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:12.710070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce6b3b06bff49a9ad0d465da0464e49'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:12.720107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce6b3b06bff49a9ad0d465da0464e49'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:12.745240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d36ff946-eb28-410a-88d8-a3c6685b6efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce6b3b06bff49a9ad0d465da0464e49'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:12.761102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1127/2262] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:12 2022] DELETE /identity/v3/users/1ce6b3b06bff49a9ad0d465da0464e49 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:12.765548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18732a-5488-4a17-89ce-ac04bf9c0e99 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:12.765951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18732a-5488-4a17-89ce-ac04bf9c0e99 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:12.766365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18732a-5488-4a17-89ce-ac04bf9c0e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:12.789182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-de18732a-5488-4a17-89ce-ac04bf9c0e99 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:12.790412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de18732a-5488-4a17-89ce-ac04bf9c0e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:12.869520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1128/2263] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:12.880649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18732a-5488-4a17-89ce-ac04bf9c0e99 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:12.882788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de18732a-5488-4a17-89ce-ac04bf9c0e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:12.918017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a47d0328d340e882dcff893716c89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:12.980890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18732a-5488-4a17-89ce-ac04bf9c0e99 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:12.986757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:12.988373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:12.988708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:12.989082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:12.991452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a47d0328d340e882dcff893716c89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:12.992316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a47d0328d340e882dcff893716c89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:13.002571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:13.005380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:13.010873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a47d0328d340e882dcff893716c89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:13.011710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a5e844c0-627f-4886-9ff7-753543c0c18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a47d0328d340e882dcff893716c89d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:13.033107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1136/2264] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:12 2022] DELETE /identity/v3/users/99a47d0328d340e882dcff893716c89d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:13.046697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1129/2265] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:13.048512 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d607ab4-5bf7-4558-8e3d-4a8cbdd36f36 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:13.049036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d607ab4-5bf7-4558-8e3d-4a8cbdd36f36 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:13.052886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d607ab4-5bf7-4558-8e3d-4a8cbdd36f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:13.093195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9d607ab4-5bf7-4558-8e3d-4a8cbdd36f36 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:13.095341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9d607ab4-5bf7-4558-8e3d-4a8cbdd36f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:13.187569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:13.189109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:13.194087 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1137/2266] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:13.205470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d607ab4-5bf7-4558-8e3d-4a8cbdd36f36 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:13.212316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9d607ab4-5bf7-4558-8e3d-4a8cbdd36f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:13.218084 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b84a4-bcce-4180-a31b-c50f9d906cec service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:13.224633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:13.225472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:13.225905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:13.226186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] PATH_INFO: `/v3/users/209329d8c4354ebc8943f18270bf16ba` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:13.227872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209329d8c4354ebc8943f18270bf16ba)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:13.229942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:13.286838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:13.309504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d607ab4-5bf7-4558-8e3d-4a8cbdd36f36 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:13.317563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:13.321998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:13.321998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:13.321998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:13.330694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:13.332913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:13.348931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1138/2267] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:13.473029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209329d8c4354ebc8943f18270bf16ba'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:13.474401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209329d8c4354ebc8943f18270bf16ba'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:13.606244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209329d8c4354ebc8943f18270bf16ba'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:13.607285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209329d8c4354ebc8943f18270bf16ba'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:13.627107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-410781ff-2b96-47da-a264-c3008ec695d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209329d8c4354ebc8943f18270bf16ba'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:13.645323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:13.649783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:13.650990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1130/2268] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:13 2022] DELETE /identity/v3/users/209329d8c4354ebc8943f18270bf16ba => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:13.658255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637bcf5-e680-4789-b9ae-7ac814b0237a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:13.658842 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637bcf5-e680-4789-b9ae-7ac814b0237a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:13.659347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637bcf5-e680-4789-b9ae-7ac814b0237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:13.676914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb1913-2856-4109-8cdd-d030c87e62fd service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:13.687270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0637bcf5-e680-4789-b9ae-7ac814b0237a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:13.688567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0637bcf5-e680-4789-b9ae-7ac814b0237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:13.805169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1131/2269] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:13.814194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637bcf5-e680-4789-b9ae-7ac814b0237a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:13.818918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0637bcf5-e680-4789-b9ae-7ac814b0237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:13.841027 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:13.842037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:13.842509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:13.843000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] PATH_INFO: `/v3/projects/381be5ff2fb14f0ab908484a1e774e06` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:13.859550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=381be5ff2fb14f0ab908484a1e774e06)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:13.860943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:13.974368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637bcf5-e680-4789-b9ae-7ac814b0237a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:13.978757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:13.979446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:13.986342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:13.986342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:14.000497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:14.009549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:14.039218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1132/2270] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:14.130922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381be5ff2fb14f0ab908484a1e774e06', 'request_id': 'req-87ddb6cc-bd21-429a-adf7-1de65359b9df'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.168247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:14.170677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:14.195528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71e765-f0f6-4efd-8341-3b82b15f5679 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:14.262694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381be5ff2fb14f0ab908484a1e774e06', 'request_id': 'req-87ddb6cc-bd21-429a-adf7-1de65359b9df'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.275102 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381be5ff2fb14f0ab908484a1e774e06', 'request_id': 'req-87ddb6cc-bd21-429a-adf7-1de65359b9df'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.303386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] The token cache is being invalidate because project 381be5ff2fb14f0ab908484a1e774e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:14.303904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.304740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.307979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:14.312487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:14.312623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1139/2271] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:13 2022] DELETE /identity/v3/projects/381be5ff2fb14f0ab908484a1e774e06 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:14.312715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:14.312715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] PATH_INFO: `/v3/projects/687f49568b2742d6adcaf630c1f9bf68` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:14.312715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687f49568b2742d6adcaf630c1f9bf68)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:14.313646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:14.314528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:14.316128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:14.330796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddb6cc-bd21-429a-adf7-1de65359b9df admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:14.336540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:14.337281 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:14.337630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:14.337973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] PATH_INFO: `/v3/users/76d7bf531d4d4bc8a6438ec7f7240a7f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:14.340335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d7bf531d4d4bc8a6438ec7f7240a7f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:14.342661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:14.494259 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687f49568b2742d6adcaf630c1f9bf68', 'request_id': 'req-133503ca-aec8-4575-8a93-272c7de066e6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.576666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d7bf531d4d4bc8a6438ec7f7240a7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.629460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687f49568b2742d6adcaf630c1f9bf68', 'request_id': 'req-133503ca-aec8-4575-8a93-272c7de066e6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.639877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687f49568b2742d6adcaf630c1f9bf68', 'request_id': 'req-133503ca-aec8-4575-8a93-272c7de066e6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.653341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] The token cache is being invalidate because project 687f49568b2742d6adcaf630c1f9bf68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:14.653730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.654464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.656467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1133/2272] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:14 2022] DELETE /identity/v3/projects/687f49568b2742d6adcaf630c1f9bf68 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:14.660417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:14.662034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:14.747615 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d7bf531d4d4bc8a6438ec7f7240a7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.748211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d7bf531d4d4bc8a6438ec7f7240a7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.780582 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133503ca-aec8-4575-8a93-272c7de066e6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:14.786222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:14.789337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:14.789337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:14.789785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d7bf531d4d4bc8a6438ec7f7240a7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.790038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] PATH_INFO: `/v3/users/808b1cd3e41b4ec687e448952412437a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:14.790112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d7bf531d4d4bc8a6438ec7f7240a7f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:14.790181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=808b1cd3e41b4ec687e448952412437a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:14.790788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:14.812746 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1140/2273] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:14 2022] DELETE /identity/v3/users/76d7bf531d4d4bc8a6438ec7f7240a7f => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:14.814411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:14.817435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:14.845036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:14.912534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f56a2-cece-4494-b7ae-7588a909c44b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:14.919548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:14.920569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:14.921024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:14.921475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] PATH_INFO: `/v3/projects/b59fcc0ddc9d41d48067e0c9350396aa` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:14.923409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59fcc0ddc9d41d48067e0c9350396aa)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:14.926251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:15.082775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808b1cd3e41b4ec687e448952412437a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.084550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808b1cd3e41b4ec687e448952412437a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.129817 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59fcc0ddc9d41d48067e0c9350396aa', 'request_id': 'req-e0350762-d360-4544-94bc-840890cd3628'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.227593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808b1cd3e41b4ec687e448952412437a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.236802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808b1cd3e41b4ec687e448952412437a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.247172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808b1cd3e41b4ec687e448952412437a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.262165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1134/2274] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:14 2022] DELETE /identity/v3/users/808b1cd3e41b4ec687e448952412437a => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:15.343380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59fcc0ddc9d41d48067e0c9350396aa', 'request_id': 'req-e0350762-d360-4544-94bc-840890cd3628'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.352756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59fcc0ddc9d41d48067e0c9350396aa', 'request_id': 'req-e0350762-d360-4544-94bc-840890cd3628'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.371141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] The token cache is being invalidate because project b59fcc0ddc9d41d48067e0c9350396aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:15.371697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.372913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.374523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1141/2275] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:14 2022] DELETE /identity/v3/projects/b59fcc0ddc9d41d48067e0c9350396aa => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:15.395166 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:15.396642 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:15.460831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:15.462942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:15.493735 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8175bff-cd14-4267-9699-feba755f58ae admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:15.499337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:15.500020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:15.506165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:15.506165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] PATH_INFO: `/v3/users/b367a58923ae485f8f7ae18b587f3a66` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:15.506165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b367a58923ae485f8f7ae18b587f3a66)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:15.506165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:15.555645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0350762-d360-4544-94bc-840890cd3628 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:15.560901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:15.561820 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:15.562284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:15.562563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] PATH_INFO: `/v3/projects/9c41c71a6b3f49cdbcdd933bb8532219` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:15.564038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c41c71a6b3f49cdbcdd933bb8532219)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:15.566706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:15.739183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b367a58923ae485f8f7ae18b587f3a66'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.739997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b367a58923ae485f8f7ae18b587f3a66'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.741780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c41c71a6b3f49cdbcdd933bb8532219', 'request_id': 'req-eb90f9cb-6214-4696-973c-d182aec34d6d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.807066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b367a58923ae485f8f7ae18b587f3a66'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.808660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b367a58923ae485f8f7ae18b587f3a66'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.824742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b367a58923ae485f8f7ae18b587f3a66'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.838373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1135/2276] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:15 2022] DELETE /identity/v3/users/b367a58923ae485f8f7ae18b587f3a66 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:15.839335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:15.841080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:15.891611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c41c71a6b3f49cdbcdd933bb8532219', 'request_id': 'req-eb90f9cb-6214-4696-973c-d182aec34d6d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.895275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:15.905419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c41c71a6b3f49cdbcdd933bb8532219', 'request_id': 'req-eb90f9cb-6214-4696-973c-d182aec34d6d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.918975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] The token cache is being invalidate because project 9c41c71a6b3f49cdbcdd933bb8532219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:15.919532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.920230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:15.922207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1142/2277] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:15 2022] DELETE /identity/v3/projects/9c41c71a6b3f49cdbcdd933bb8532219 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:15.923472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:15.926456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:15.930643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a6f6-c5f7-408d-ab52-b11da7b7e0ef admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:15.936053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:15.936704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:15.937028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:15.937305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] PATH_INFO: `/v3/users/574f424898764cf78efef8c91054946a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:15.938462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=574f424898764cf78efef8c91054946a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:15.940474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:15.998885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90f9cb-6214-4696-973c-d182aec34d6d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:16.005588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:16.006247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:16.006533 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:16.006864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] PATH_INFO: `/v3/projects/7715b6e760264c21b1d2e527f3238495` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:16.010143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7715b6e760264c21b1d2e527f3238495)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:16.010143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:16.261471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574f424898764cf78efef8c91054946a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.262925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574f424898764cf78efef8c91054946a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.276209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7715b6e760264c21b1d2e527f3238495', 'request_id': 'req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.389195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574f424898764cf78efef8c91054946a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.390242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574f424898764cf78efef8c91054946a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.405818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6144ab06-b670-42e4-b1aa-d49338286a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574f424898764cf78efef8c91054946a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.427600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1136/2278] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:15 2022] DELETE /identity/v3/users/574f424898764cf78efef8c91054946a => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:16.427600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243a43-cfc3-4536-a6c6-e22d378b3ca5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:16.427600 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243a43-cfc3-4536-a6c6-e22d378b3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:16.429298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d243a43-cfc3-4536-a6c6-e22d378b3ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:16.481336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0d243a43-cfc3-4536-a6c6-e22d378b3ca5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:16.482743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7715b6e760264c21b1d2e527f3238495', 'request_id': 'req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.485946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0d243a43-cfc3-4536-a6c6-e22d378b3ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:16.492266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7715b6e760264c21b1d2e527f3238495', 'request_id': 'req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.506967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] The token cache is being invalidate because project 7715b6e760264c21b1d2e527f3238495 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:16.506967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.507226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.509051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1143/2279] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:15 2022] DELETE /identity/v3/projects/7715b6e760264c21b1d2e527f3238495 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:16.509630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:16.511908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:16.634488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1137/2280] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:16.634703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590a185-2c68-4aa8-8e8b-5a89bf5bdaaf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:16.634828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086cb2b-dbbf-4ed0-b415-c59d1075a0ac None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:16.634828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086cb2b-dbbf-4ed0-b415-c59d1075a0ac None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:16.634828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086cb2b-dbbf-4ed0-b415-c59d1075a0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:16.639590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:16.640287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:16.640572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:16.641096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] PATH_INFO: `/v3/projects/bcebb90b2d164739bc1a13452317f02d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:16.642335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcebb90b2d164739bc1a13452317f02d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:16.645301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:16.657101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1086cb2b-dbbf-4ed0-b415-c59d1075a0ac None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:16.658670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1086cb2b-dbbf-4ed0-b415-c59d1075a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:16.668222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1138/2281] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:16.669403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0aa2-2c2e-4fdd-9267-d2267bdfdd15 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:16.669690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0aa2-2c2e-4fdd-9267-d2267bdfdd15 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:16.669962 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0aa2-2c2e-4fdd-9267-d2267bdfdd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:16.696880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cb4c0aa2-2c2e-4fdd-9267-d2267bdfdd15 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:16.697363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cb4c0aa2-2c2e-4fdd-9267-d2267bdfdd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:16.708219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1139/2282] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:16.709509 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310ec7-4801-44be-9ed1-c7f7f517108d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:16.709795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310ec7-4801-44be-9ed1-c7f7f517108d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:16.714155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310ec7-4801-44be-9ed1-c7f7f517108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:16.736107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-cb310ec7-4801-44be-9ed1-c7f7f517108d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:16.736679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cb310ec7-4801-44be-9ed1-c7f7f517108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:16.756070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1140/2283] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:16.757168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310ec7-4801-44be-9ed1-c7f7f517108d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:16.758164 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cb310ec7-4801-44be-9ed1-c7f7f517108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:16.799494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcebb90b2d164739bc1a13452317f02d', 'request_id': 'req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.854039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310ec7-4801-44be-9ed1-c7f7f517108d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:16.922750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcebb90b2d164739bc1a13452317f02d', 'request_id': 'req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.928956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dff44e-d76e-454b-a142-80ddf5ce3419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:16.929629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dff44e-d76e-454b-a142-80ddf5ce3419 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:16.929915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dff44e-d76e-454b-a142-80ddf5ce3419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:16.932080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dff44e-d76e-454b-a142-80ddf5ce3419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:16.932683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcebb90b2d164739bc1a13452317f02d', 'request_id': 'req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.950304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] The token cache is being invalidate because project bcebb90b2d164739bc1a13452317f02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:16.952005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.954667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-33d0fb9f-b3b0-42b3-ab56-4c44e317c36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:16.955876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1144/2284] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:16 2022] DELETE /identity/v3/projects/bcebb90b2d164739bc1a13452317f02d => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:16.961080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c88e-de53-4f37-b0da-125fc9081825 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:16.961080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c88e-de53-4f37-b0da-125fc9081825 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:16.961457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c88e-de53-4f37-b0da-125fc9081825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:16.992695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-9f89c88e-de53-4f37-b0da-125fc9081825 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:16.994402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9f89c88e-de53-4f37-b0da-125fc9081825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:17.045379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dff44e-d76e-454b-a142-80ddf5ce3419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.055769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dff44e-d76e-454b-a142-80ddf5ce3419 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.071605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1141/2285] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:17.071605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dff44e-d76e-454b-a142-80ddf5ce3419 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.084819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dff44e-d76e-454b-a142-80ddf5ce3419 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.091589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.092570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.094525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.094525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.094525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:17.094944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.096571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.099024 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1145/2286] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:17.105106 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7ddf-076e-4996-8f77-f5b763d4b228 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.105395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7ddf-076e-4996-8f77-f5b763d4b228 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.106191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d7ddf-076e-4996-8f77-f5b763d4b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.112217 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1142/2287] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:17.115002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.125299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9886fd6-5602-44e2-adf1-82b8cfe11002 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.130606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a38d7ddf-076e-4996-8f77-f5b763d4b228 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:17.131318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b64454-427e-44e0-8a10-475d1c5aeee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.132284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a38d7ddf-076e-4996-8f77-f5b763d4b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:17.132845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b64454-427e-44e0-8a10-475d1c5aeee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.132845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b64454-427e-44e0-8a10-475d1c5aeee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.133156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b64454-427e-44e0-8a10-475d1c5aeee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.133723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b64454-427e-44e0-8a10-475d1c5aeee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:17.134033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b64454-427e-44e0-8a10-475d1c5aeee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.135634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b64454-427e-44e0-8a10-475d1c5aeee7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.141442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1146/2288] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:17.142695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d7ddf-076e-4996-8f77-f5b763d4b228 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.144991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a38d7ddf-076e-4996-8f77-f5b763d4b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:17.161477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d7ddf-076e-4996-8f77-f5b763d4b228 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.162114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1143/2289] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:17.164089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b863-01be-4dc4-b624-5992c46aeeda None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.164385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b863-01be-4dc4-b624-5992c46aeeda None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.164674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7b863-01be-4dc4-b624-5992c46aeeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.169210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad58c-3169-451f-b13c-37edcffb3321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.170663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad58c-3169-451f-b13c-37edcffb3321 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.171016 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad58c-3169-451f-b13c-37edcffb3321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.175264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebad58c-3169-451f-b13c-37edcffb3321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.175264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad58c-3169-451f-b13c-37edcffb3321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.175264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebad58c-3169-451f-b13c-37edcffb3321 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.189750 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ddd7b863-01be-4dc4-b624-5992c46aeeda None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:17.191241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ddd7b863-01be-4dc4-b624-5992c46aeeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:17.207974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1144/2290] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:17.209103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7b863-01be-4dc4-b624-5992c46aeeda None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.220656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7b863-01be-4dc4-b624-5992c46aeeda None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.225399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:17.226764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54ef6a-e082-4c29-952e-985b94a28174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.227650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54ef6a-e082-4c29-952e-985b94a28174 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.227968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54ef6a-e082-4c29-952e-985b94a28174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.228243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54ef6a-e082-4c29-952e-985b94a28174 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.228884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54ef6a-e082-4c29-952e-985b94a28174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.230798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54ef6a-e082-4c29-952e-985b94a28174 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.331075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1147/2291] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:17 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:17.331075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad58c-3169-451f-b13c-37edcffb3321 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.365525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1145/2292] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:17 2022] POST /identity/v3/projects => generated 409 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:17.366513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54ef6a-e082-4c29-952e-985b94a28174 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.492165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebad58c-3169-451f-b13c-37edcffb3321 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.557978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54ef6a-e082-4c29-952e-985b94a28174 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.579599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c961cd8-d8e7-4fd4-8f85-671680e0bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.580732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961cd8-d8e7-4fd4-8f85-671680e0bf42 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.593235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961cd8-d8e7-4fd4-8f85-671680e0bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.593235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c961cd8-d8e7-4fd4-8f85-671680e0bf42 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.593235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c961cd8-d8e7-4fd4-8f85-671680e0bf42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.593235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c961cd8-d8e7-4fd4-8f85-671680e0bf42 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.604917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.605686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.606071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.608350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.608350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:17.608350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.609571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.626184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1148/2293] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:17.627245 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.640742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba8d29-cbbe-41c3-bb5d-3926ce1cc90f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.646835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12a642-c228-47d1-bd86-8f7a69f9a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.647459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12a642-c228-47d1-bd86-8f7a69f9a2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.647788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12a642-c228-47d1-bd86-8f7a69f9a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.649935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12a642-c228-47d1-bd86-8f7a69f9a2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.649935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12a642-c228-47d1-bd86-8f7a69f9a2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.651351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12a642-c228-47d1-bd86-8f7a69f9a2f2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.678464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1146/2294] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:17 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:17.679417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c961cd8-d8e7-4fd4-8f85-671680e0bf42 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.693128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c961cd8-d8e7-4fd4-8f85-671680e0bf42 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.698039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930dd5-d5dd-4498-993c-aff996a4150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.698648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930dd5-d5dd-4498-993c-aff996a4150e admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.699049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930dd5-d5dd-4498-993c-aff996a4150e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.699275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930dd5-d5dd-4498-993c-aff996a4150e admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.699879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e930dd5-d5dd-4498-993c-aff996a4150e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.701819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e930dd5-d5dd-4498-993c-aff996a4150e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.770770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1149/2295] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:17 2022] POST /identity/v3/users => generated 305 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:17.770970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12a642-c228-47d1-bd86-8f7a69f9a2f2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.782247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12a642-c228-47d1-bd86-8f7a69f9a2f2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.789939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.790739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.791134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.791514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.792393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.794041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.808175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1150/2296] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:17.809235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.811286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:17.830513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6414bcc-53de-4e19-9f81-e878ebf5c42e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.834978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1147/2297] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:17 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:17.835998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930dd5-d5dd-4498-993c-aff996a4150e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.844438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.845726 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.846020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.846798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] PATH_INFO: `/v3/projects/64ae8101b8594bde95f143b06ee871b3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.848365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ae8101b8594bde95f143b06ee871b3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.850419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.916480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930dd5-d5dd-4498-993c-aff996a4150e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.922243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426699-e2c4-4363-ae0f-ff7114bf12f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.923443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426699-e2c4-4363-ae0f-ff7114bf12f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.923759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426699-e2c4-4363-ae0f-ff7114bf12f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.924200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426699-e2c4-4363-ae0f-ff7114bf12f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.924990 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b426699-e2c4-4363-ae0f-ff7114bf12f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.927331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b426699-e2c4-4363-ae0f-ff7114bf12f2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.940139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1148/2298] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:17.942497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426699-e2c4-4363-ae0f-ff7114bf12f2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:17.955064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426699-e2c4-4363-ae0f-ff7114bf12f2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:17.961822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b4cfb-4e5d-4cee-9d68-e1135b0db198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:17.962466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4cfb-4e5d-4cee-9d68-e1135b0db198 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:17.962826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4cfb-4e5d-4cee-9d68-e1135b0db198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:17.963291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4cfb-4e5d-4cee-9d68-e1135b0db198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:17.964070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b4cfb-4e5d-4cee-9d68-e1135b0db198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:17.965757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b4cfb-4e5d-4cee-9d68-e1135b0db198 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:17.983613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ae8101b8594bde95f143b06ee871b3', 'request_id': 'req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:17.990944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1149/2299] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:17.991808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b4cfb-4e5d-4cee-9d68-e1135b0db198 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.002208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b4cfb-4e5d-4cee-9d68-e1135b0db198 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.067249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.067918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.068202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.068478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.069262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:18.071406 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:18.107756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ae8101b8594bde95f143b06ee871b3', 'request_id': 'req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.116091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ae8101b8594bde95f143b06ee871b3', 'request_id': 'req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.127917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] The token cache is being invalidate because project 64ae8101b8594bde95f143b06ee871b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:18.129524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.133022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.134459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1151/2300] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:17 2022] DELETE /identity/v3/projects/64ae8101b8594bde95f143b06ee871b3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:18.135835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.137318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:18.156068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f1a096-9dc4-478e-9351-9dbb7e4c31ba admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.165433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.168797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.168797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.168797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.169774 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:18.173361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:18.186350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1152/2301] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:18.190404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.190404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:18.212785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419e793-5e8b-46e0-8501-18effca5d419 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.219085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693045b-2976-4264-871a-cd890d6940af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.219793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693045b-2976-4264-871a-cd890d6940af admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.220078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693045b-2976-4264-871a-cd890d6940af admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.220353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693045b-2976-4264-871a-cd890d6940af admin admin] PATH_INFO: `/v3/projects/0d3834cbff0c4fba9b101ebe799be5c8/users/f692f780705643a09f13ac90721f1835/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.236434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1150/2302] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:17 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:18.236434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.237591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:18.254907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693045b-2976-4264-871a-cd890d6940af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3834cbff0c4fba9b101ebe799be5c8, user_id=f692f780705643a09f13ac90721f1835, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:18.255124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:18.257654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693045b-2976-4264-871a-cd890d6940af admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:18.262365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75b36b-2e93-4bd0-ba4b-b83599f2b1c9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.266660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.267427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.267953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.268233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] PATH_INFO: `/v3/users/45854ea06bde4346997e2d11d5bd5de4` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.270865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] RBAC: Authorizing `identity:delete_user(user_id=45854ea06bde4346997e2d11d5bd5de4)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:18.276569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:18.332671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1153/2303] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:18 2022] PUT /identity/v3/projects/0d3834cbff0c4fba9b101ebe799be5c8/users/f692f780705643a09f13ac90721f1835/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:18.333857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693045b-2976-4264-871a-cd890d6940af admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.411251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693045b-2976-4264-871a-cd890d6940af admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.416591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.417266 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.417549 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.417823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] PATH_INFO: `/v3/projects/5e0c5e9da37e4d959a0e282e5903aebf/users/7990de81ebf64aaeb6c44dfd10a9555e/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.435157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0c5e9da37e4d959a0e282e5903aebf, user_id=7990de81ebf64aaeb6c44dfd10a9555e, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:18.438371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:18.473855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45854ea06bde4346997e2d11d5bd5de4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.474726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45854ea06bde4346997e2d11d5bd5de4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.524109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1154/2304] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:18 2022] PUT /identity/v3/projects/5e0c5e9da37e4d959a0e282e5903aebf/users/7990de81ebf64aaeb6c44dfd10a9555e/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:18.525739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.527427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:18.540611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45854ea06bde4346997e2d11d5bd5de4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.541694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45854ea06bde4346997e2d11d5bd5de4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.578963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-57bcf792-4c73-4766-bc13-d0c45b8e954a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45854ea06bde4346997e2d11d5bd5de4'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:18.619944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1151/2305] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:18 2022] DELETE /identity/v3/users/45854ea06bde4346997e2d11d5bd5de4 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:18.621918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d055bb-8e4f-458b-9654-933c5fd457ea None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.622465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d055bb-8e4f-458b-9654-933c5fd457ea None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.622883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d055bb-8e4f-458b-9654-933c5fd457ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.694852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354e788-e7a2-4c32-a4a6-7389b28f5e2d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.700824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-24d055bb-8e4f-458b-9654-933c5fd457ea None None] MFA Rules not processed for user `f692f780705643a09f13ac90721f1835`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:18.706444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-24d055bb-8e4f-458b-9654-933c5fd457ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:18.803210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0757e-51da-4449-b8bf-b7f75aad66f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.803210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0757e-51da-4449-b8bf-b7f75aad66f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.803537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0757e-51da-4449-b8bf-b7f75aad66f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.803956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0757e-51da-4449-b8bf-b7f75aad66f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.804480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0757e-51da-4449-b8bf-b7f75aad66f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:18.807371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0757e-51da-4449-b8bf-b7f75aad66f1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:18.826051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1155/2306] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:18.827214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0b4c-e393-443b-86b1-ee29de4ac555 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.827424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0b4c-e393-443b-86b1-ee29de4ac555 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.827696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c0b4c-e393-443b-86b1-ee29de4ac555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.838607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1152/2307] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:18.841647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d055bb-8e4f-458b-9654-933c5fd457ea None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.859228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d055bb-8e4f-458b-9654-933c5fd457ea None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.865550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-ec9c0b4c-e393-443b-86b1-ee29de4ac555 None None] MFA Rules not processed for user `7990de81ebf64aaeb6c44dfd10a9555e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:18.866532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.867821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ec9c0b4c-e393-443b-86b1-ee29de4ac555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:18.867932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.868299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.868782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.869798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:18.882346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:18.902098 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1153/2308] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:18.902957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.905055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:18.925133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147d9be-f527-48d9-a23f-e06f13e6c964 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.927194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.928124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.928510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.928882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:18.930072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:18.932515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:18.976658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1156/2309] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:18 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:18.978185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c0b4c-e393-443b-86b1-ee29de4ac555 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:18.991088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c0b4c-e393-443b-86b1-ee29de4ac555 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:18.996418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ec8c8-c3b9-4740-b8bd-c25b59a77a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:18.997126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ec8c8-c3b9-4740-b8bd-c25b59a77a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:18.997417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ec8c8-c3b9-4740-b8bd-c25b59a77a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:18.997966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ec8c8-c3b9-4740-b8bd-c25b59a77a76 admin admin] PATH_INFO: `/v3/projects/5744981e55634330b498879fbe46280f/users/44a1b17b187e43a393f12227ccf296d8/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:19.019988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ec8c8-c3b9-4740-b8bd-c25b59a77a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5744981e55634330b498879fbe46280f, user_id=44a1b17b187e43a393f12227ccf296d8, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:19.023040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ec8c8-c3b9-4740-b8bd-c25b59a77a76 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:19.105026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1154/2310] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:18 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:19.105026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:19.105026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:19.188815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1157/2311] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:18 2022] PUT /identity/v3/projects/5744981e55634330b498879fbe46280f/users/44a1b17b187e43a393f12227ccf296d8/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:19.189794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ec8c8-c3b9-4740-b8bd-c25b59a77a76 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:19.195419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3292ac5-ac61-43dd-b487-f16dda1c1dd2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:19.301493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ec8c8-c3b9-4740-b8bd-c25b59a77a76 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:19.307966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:19.308521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f67f86-4b02-4e51-95e7-1e7e5e6783ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:19.308760 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:19.309125 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:19.309583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f67f86-4b02-4e51-95e7-1e7e5e6783ba admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:19.309707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:19.309814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f67f86-4b02-4e51-95e7-1e7e5e6783ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:19.309995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f67f86-4b02-4e51-95e7-1e7e5e6783ba admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:19.310106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:19.310922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f67f86-4b02-4e51-95e7-1e7e5e6783ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:19.311997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:19.313032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f67f86-4b02-4e51-95e7-1e7e5e6783ba admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:19.474941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1158/2312] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:19 2022] POST /identity/v3/users => generated 298 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:19.476112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1155/2313] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:19 2022] POST /identity/v3/projects => generated 409 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:19.476569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aecd3d-3d11-4b00-bef0-4e4919f04469 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:19.476810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aecd3d-3d11-4b00-bef0-4e4919f04469 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:19.477355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aecd3d-3d11-4b00-bef0-4e4919f04469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:19.478355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:19.480712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:19.515114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-36aecd3d-3d11-4b00-bef0-4e4919f04469 None None] MFA Rules not processed for user `44a1b17b187e43a393f12227ccf296d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:19.517048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-36aecd3d-3d11-4b00-bef0-4e4919f04469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:19.555636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4549c8-a22d-472a-86c7-24a9a14ffc5a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:19.561058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:19.561637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:19.562083 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:19.562372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:19.562654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] PATH_INFO: `/v3/projects/8ee1923c06284997acb432b92f2a60f2` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:19.563858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee1923c06284997acb432b92f2a60f2)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:19.566073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:19.601914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1159/2314] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:19.603262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aecd3d-3d11-4b00-bef0-4e4919f04469 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:19.619237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aecd3d-3d11-4b00-bef0-4e4919f04469 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:19.624775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e65dd-4edd-42f8-a6fb-c01bb7e041e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:19.625418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e65dd-4edd-42f8-a6fb-c01bb7e041e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:19.625840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e65dd-4edd-42f8-a6fb-c01bb7e041e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:19.626141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e65dd-4edd-42f8-a6fb-c01bb7e041e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:19.626825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e65dd-4edd-42f8-a6fb-c01bb7e041e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:19.628732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e65dd-4edd-42f8-a6fb-c01bb7e041e2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:19.647664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1160/2315] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:19.647664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e65dd-4edd-42f8-a6fb-c01bb7e041e2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:19.662356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e65dd-4edd-42f8-a6fb-c01bb7e041e2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:19.669624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1856a34-5b3e-474d-a748-878eafe8d42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:19.670262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1856a34-5b3e-474d-a748-878eafe8d42e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:19.670599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1856a34-5b3e-474d-a748-878eafe8d42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:19.671025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1856a34-5b3e-474d-a748-878eafe8d42e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:19.672016 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1856a34-5b3e-474d-a748-878eafe8d42e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:19.674026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1856a34-5b3e-474d-a748-878eafe8d42e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:19.766451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee1923c06284997acb432b92f2a60f2', 'request_id': 'req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:19.840826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1161/2316] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:19 2022] POST /identity/v3/users => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:19.843086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1856a34-5b3e-474d-a748-878eafe8d42e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:19.852876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1856a34-5b3e-474d-a748-878eafe8d42e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:19.903253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee1923c06284997acb432b92f2a60f2', 'request_id': 'req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:19.912369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee1923c06284997acb432b92f2a60f2', 'request_id': 'req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:19.926507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] The token cache is being invalidate because project 8ee1923c06284997acb432b92f2a60f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:19.926680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:19.928142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:19.929926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:19.930066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1156/2317] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:19 2022] DELETE /identity/v3/projects/8ee1923c06284997acb432b92f2a60f2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:19.930461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:19.930714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:19.931386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:19.931872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:19.931975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:19.933223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:19.937153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:19.945808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:19.957678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d53c0d-c721-4a64-91f3-7ea3d2c3d454 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:19.977564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bcab9-e50c-4bd5-9105-ec7d0fe6bd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:19.978681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bcab9-e50c-4bd5-9105-ec7d0fe6bd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:19.979039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bcab9-e50c-4bd5-9105-ec7d0fe6bd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:19.979320 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bcab9-e50c-4bd5-9105-ec7d0fe6bd03 admin admin] PATH_INFO: `/v3/projects/ae65f03d1be440529da45628e806c142/users/f9dc1a8e6a0c464ca23ce37ca499d561/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.007584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bcab9-e50c-4bd5-9105-ec7d0fe6bd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae65f03d1be440529da45628e806c142, user_id=f9dc1a8e6a0c464ca23ce37ca499d561, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.012208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bcab9-e50c-4bd5-9105-ec7d0fe6bd03 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.048280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1162/2318] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:19 2022] POST /identity/v3/projects => generated 365 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:20.050227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.052014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:20.138241 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7c084-6a0a-4d79-826c-e5dce100b427 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.143038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703008f1-3c23-4371-8ce2-7a10a211a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.143663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703008f1-3c23-4371-8ce2-7a10a211a5dd admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.144652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703008f1-3c23-4371-8ce2-7a10a211a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.145322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703008f1-3c23-4371-8ce2-7a10a211a5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.146014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703008f1-3c23-4371-8ce2-7a10a211a5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.147637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703008f1-3c23-4371-8ce2-7a10a211a5dd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.161713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1163/2319] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:20.161713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdac06-a189-42aa-9cd4-6a5900bef865 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.161713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdac06-a189-42aa-9cd4-6a5900bef865 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.161713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdac06-a189-42aa-9cd4-6a5900bef865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.186180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6acdac06-a189-42aa-9cd4-6a5900bef865 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:20.187283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6acdac06-a189-42aa-9cd4-6a5900bef865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:20.197735 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1164/2320] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:20.198698 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdac06-a189-42aa-9cd4-6a5900bef865 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.203780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6acdac06-a189-42aa-9cd4-6a5900bef865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:20.218790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdac06-a189-42aa-9cd4-6a5900bef865 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.221557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1157/2321] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:19 2022] PUT /identity/v3/projects/ae65f03d1be440529da45628e806c142/users/f9dc1a8e6a0c464ca23ce37ca499d561/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:20.223318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bcab9-e50c-4bd5-9105-ec7d0fe6bd03 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.298251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08370baf-00cd-49b0-aa92-615ba9dc7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.299154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370baf-00cd-49b0-aa92-615ba9dc7891 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.299443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370baf-00cd-49b0-aa92-615ba9dc7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.299823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08370baf-00cd-49b0-aa92-615ba9dc7891 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.301286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08370baf-00cd-49b0-aa92-615ba9dc7891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.303285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08370baf-00cd-49b0-aa92-615ba9dc7891 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.315369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bcab9-e50c-4bd5-9105-ec7d0fe6bd03 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.320780 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba90842-8d01-46d2-929c-843463e5e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.321476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba90842-8d01-46d2-929c-843463e5e359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.321757 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba90842-8d01-46d2-929c-843463e5e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.322032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba90842-8d01-46d2-929c-843463e5e359 admin admin] PATH_INFO: `/v3/projects/1e4f846272cb4aaca8f840d2873040c7/users/bd8253352cb74781a8180e2166aa6fcc/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.341244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba90842-8d01-46d2-929c-843463e5e359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4f846272cb4aaca8f840d2873040c7, user_id=bd8253352cb74781a8180e2166aa6fcc, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.343978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba90842-8d01-46d2-929c-843463e5e359 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.434690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1165/2322] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:20 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:20.435925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc257c-07be-4376-9b00-9962adcaa59e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.436220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc257c-07be-4376-9b00-9962adcaa59e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.436500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc257c-07be-4376-9b00-9962adcaa59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.472243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1158/2323] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:20 2022] PUT /identity/v3/projects/1e4f846272cb4aaca8f840d2873040c7/users/bd8253352cb74781a8180e2166aa6fcc/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:20.472243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba90842-8d01-46d2-929c-843463e5e359 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.563110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba90842-8d01-46d2-929c-843463e5e359 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.569685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15903ad-3703-4c8e-b076-33b2389dbd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.570322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15903ad-3703-4c8e-b076-33b2389dbd23 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.570614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15903ad-3703-4c8e-b076-33b2389dbd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.570886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15903ad-3703-4c8e-b076-33b2389dbd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.571546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15903ad-3703-4c8e-b076-33b2389dbd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.573195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15903ad-3703-4c8e-b076-33b2389dbd23 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.585395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1159/2324] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:20.586708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564499b-00a3-4ead-a6da-daddd3850085 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.587181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564499b-00a3-4ead-a6da-daddd3850085 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.587647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564499b-00a3-4ead-a6da-daddd3850085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.588447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-91cc257c-07be-4376-9b00-9962adcaa59e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:20.590044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-91cc257c-07be-4376-9b00-9962adcaa59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:20.599639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1166/2325] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:20.604120 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc257c-07be-4376-9b00-9962adcaa59e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.612318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e564499b-00a3-4ead-a6da-daddd3850085 None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:20.613614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e564499b-00a3-4ead-a6da-daddd3850085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:20.613776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc257c-07be-4376-9b00-9962adcaa59e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.618983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd98ce8-c7af-49b2-b50c-529a5fd7217e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.619658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd98ce8-c7af-49b2-b50c-529a5fd7217e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.619976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd98ce8-c7af-49b2-b50c-529a5fd7217e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.620287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd98ce8-c7af-49b2-b50c-529a5fd7217e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.621001 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd98ce8-c7af-49b2-b50c-529a5fd7217e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.622637 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd98ce8-c7af-49b2-b50c-529a5fd7217e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.633317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1167/2326] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:20.641541 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd98ce8-c7af-49b2-b50c-529a5fd7217e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.646303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd98ce8-c7af-49b2-b50c-529a5fd7217e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.653584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5423f3-19c9-494d-a39b-55b7c56e5649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.655010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5423f3-19c9-494d-a39b-55b7c56e5649 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.655280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5423f3-19c9-494d-a39b-55b7c56e5649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.655560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5423f3-19c9-494d-a39b-55b7c56e5649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.657236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5423f3-19c9-494d-a39b-55b7c56e5649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.660876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5423f3-19c9-494d-a39b-55b7c56e5649 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.678651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1168/2327] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:20.679785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5423f3-19c9-494d-a39b-55b7c56e5649 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.681804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1160/2328] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:20.682843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564499b-00a3-4ead-a6da-daddd3850085 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.700248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5423f3-19c9-494d-a39b-55b7c56e5649 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.701723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564499b-00a3-4ead-a6da-daddd3850085 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.711445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.712116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.712400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.712677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.713354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:20.713983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.715293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.715643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdbab0-0c4d-4719-8845-6402656a7a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.717432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdbab0-0c4d-4719-8845-6402656a7a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.718523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdbab0-0c4d-4719-8845-6402656a7a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.719211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdbab0-0c4d-4719-8845-6402656a7a95 admin admin] PATH_INFO: `/v3/projects/ae65f03d1be440529da45628e806c142/users/f9dc1a8e6a0c464ca23ce37ca499d561/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.732187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdbab0-0c4d-4719-8845-6402656a7a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae65f03d1be440529da45628e806c142, user_id=f9dc1a8e6a0c464ca23ce37ca499d561, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.734366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1161/2329] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:20.734732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.738629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bdbab0-0c4d-4719-8845-6402656a7a95 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.745741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52b43f-015c-4569-99e4-2b2ff7614ca3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.751861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.752833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.753112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.756983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1169/2330] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:20 2022] PUT /identity/v3/projects/ae65f03d1be440529da45628e806c142/users/f9dc1a8e6a0c464ca23ce37ca499d561/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:20.758621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdbab0-0c4d-4719-8845-6402656a7a95 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.760616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] PATH_INFO: `/v3/projects/44eb3319ca934b6fb6063c09ec206e17/users/c43d53b23f704078bdd24b574e890a7d/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.788021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44eb3319ca934b6fb6063c09ec206e17, user_id=c43d53b23f704078bdd24b574e890a7d, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.793117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.875715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdbab0-0c4d-4719-8845-6402656a7a95 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:20.891744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1162/2331] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:20 2022] PUT /identity/v3/projects/44eb3319ca934b6fb6063c09ec206e17/users/c43d53b23f704078bdd24b574e890a7d/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:20.891744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:20.891744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:20.892477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ff6b3-7515-4189-be70-82ebd9d31b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:20.893184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ff6b3-7515-4189-be70-82ebd9d31b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:20.893471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ff6b3-7515-4189-be70-82ebd9d31b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:20.893780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ff6b3-7515-4189-be70-82ebd9d31b26 admin admin] PATH_INFO: `/v3/projects/1e4f846272cb4aaca8f840d2873040c7/users/bd8253352cb74781a8180e2166aa6fcc/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:20.896054 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ff6b3-7515-4189-be70-82ebd9d31b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4f846272cb4aaca8f840d2873040c7, user_id=bd8253352cb74781a8180e2166aa6fcc, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:20.898943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ff6b3-7515-4189-be70-82ebd9d31b26 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:20.912563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1170/2332] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:20 2022] PUT /identity/v3/projects/1e4f846272cb4aaca8f840d2873040c7/users/bd8253352cb74781a8180e2166aa6fcc/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:20.913756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ff6b3-7515-4189-be70-82ebd9d31b26 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.013569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ff6b3-7515-4189-be70-82ebd9d31b26 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.013799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644143e-cccf-46a4-a94e-ccd33034476a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.018775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceb9ba-3016-458f-8c2b-db52138d26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.019773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceb9ba-3016-458f-8c2b-db52138d26c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.019773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceb9ba-3016-458f-8c2b-db52138d26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.020852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceb9ba-3016-458f-8c2b-db52138d26c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.020852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ceb9ba-3016-458f-8c2b-db52138d26c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.022570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ceb9ba-3016-458f-8c2b-db52138d26c0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.103285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd916a-97c3-4064-9906-57a9cafcb0ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.104028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd916a-97c3-4064-9906-57a9cafcb0ac service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.104321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd916a-97c3-4064-9906-57a9cafcb0ac service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.104656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd916a-97c3-4064-9906-57a9cafcb0ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.146059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1171/2333] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:20 2022] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:21.148601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81effd40-3f5c-4a36-971d-879d3385daa0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.148871 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81effd40-3f5c-4a36-971d-879d3385daa0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.150051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81effd40-3f5c-4a36-971d-879d3385daa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.178771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd916a-97c3-4064-9906-57a9cafcb0ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.180410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd916a-97c3-4064-9906-57a9cafcb0ac service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.181121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-81effd40-3f5c-4a36-971d-879d3385daa0 None None] MFA Rules not processed for user `f9dc1a8e6a0c464ca23ce37ca499d561`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:21.183321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-81effd40-3f5c-4a36-971d-879d3385daa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:21.192445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1163/2334] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:19:21.193526 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd916a-97c3-4064-9906-57a9cafcb0ac service swift] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.210830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd916a-97c3-4064-9906-57a9cafcb0ac service swift] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.277771 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:21.287500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1172/2335] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:21.287500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ade29-9b2b-4118-9731-28a09b35d437 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.287500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ade29-9b2b-4118-9731-28a09b35d437 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.287500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ade29-9b2b-4118-9731-28a09b35d437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.289479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49448b-7986-4be7-8d63-136f78c441d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.290303 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49448b-7986-4be7-8d63-136f78c441d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.290586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49448b-7986-4be7-8d63-136f78c441d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.290867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49448b-7986-4be7-8d63-136f78c441d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.291767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49448b-7986-4be7-8d63-136f78c441d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.293496 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49448b-7986-4be7-8d63-136f78c441d3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.306080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1164/2336] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:21.307250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49448b-7986-4be7-8d63-136f78c441d3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.329739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49448b-7986-4be7-8d63-136f78c441d3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.332647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-228ade29-9b2b-4118-9731-28a09b35d437 None None] MFA Rules not processed for user `bd8253352cb74781a8180e2166aa6fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:21.334282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-228ade29-9b2b-4118-9731-28a09b35d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:21.344104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.345211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.345567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.345939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.346708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.353980 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.418283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1173/2337] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:21.418681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ade29-9b2b-4118-9731-28a09b35d437 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.432053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ade29-9b2b-4118-9731-28a09b35d437 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.436714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ae5f7-4a8b-4431-9690-b46ebf1daea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.437394 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae5f7-4a8b-4431-9690-b46ebf1daea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.437672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae5f7-4a8b-4431-9690-b46ebf1daea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.437946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ae5f7-4a8b-4431-9690-b46ebf1daea3 admin admin] PATH_INFO: `/v3/projects/44eb3319ca934b6fb6063c09ec206e17/users/c43d53b23f704078bdd24b574e890a7d/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.440009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ae5f7-4a8b-4431-9690-b46ebf1daea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44eb3319ca934b6fb6063c09ec206e17, user_id=c43d53b23f704078bdd24b574e890a7d, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.443400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ae5f7-4a8b-4431-9690-b46ebf1daea3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.454623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1165/2338] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:21 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:21.454623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.454623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:21.458683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1174/2339] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:21 2022] PUT /identity/v3/projects/44eb3319ca934b6fb6063c09ec206e17/users/c43d53b23f704078bdd24b574e890a7d/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:21.458683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ae5f7-4a8b-4431-9690-b46ebf1daea3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.560369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebf33b-65a3-45ec-9e9a-31e2823a8dcc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.570066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ae5f7-4a8b-4431-9690-b46ebf1daea3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.577184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284fba1-d1cb-44c9-9b9b-7d4f6165871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.577894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fba1-d1cb-44c9-9b9b-7d4f6165871c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.578201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fba1-d1cb-44c9-9b9b-7d4f6165871c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.578484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284fba1-d1cb-44c9-9b9b-7d4f6165871c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.579221 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284fba1-d1cb-44c9-9b9b-7d4f6165871c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.581197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284fba1-d1cb-44c9-9b9b-7d4f6165871c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.610371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1175/2340] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:21.611908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3b15-7156-45fb-9f7d-e65a15291267 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.612196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3b15-7156-45fb-9f7d-e65a15291267 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.612467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3b15-7156-45fb-9f7d-e65a15291267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.627566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.628356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.629269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.629541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.656825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1abf3b15-7156-45fb-9f7d-e65a15291267 None None] MFA Rules not processed for user `c43d53b23f704078bdd24b574e890a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:21.658228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1abf3b15-7156-45fb-9f7d-e65a15291267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:21.701975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.703411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.717002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1166/2341] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:21.726382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.729066 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:21.759629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1176/2342] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:21.763000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf3b15-7156-45fb-9f7d-e65a15291267 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.763283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24840cc0-f3a8-4a95-8b16-3da6a401684d service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.774277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651a9f1-3955-4a12-b57d-3e89f29d5c97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.774927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a9f1-3955-4a12-b57d-3e89f29d5c97 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.775224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a9f1-3955-4a12-b57d-3e89f29d5c97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.775507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a9f1-3955-4a12-b57d-3e89f29d5c97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.782457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf3b15-7156-45fb-9f7d-e65a15291267 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.790464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb109-5c2a-422f-b22e-8d169c7a3614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.791156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb109-5c2a-422f-b22e-8d169c7a3614 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.791513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb109-5c2a-422f-b22e-8d169c7a3614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.791884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb109-5c2a-422f-b22e-8d169c7a3614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.792678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fb109-5c2a-422f-b22e-8d169c7a3614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.794705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fb109-5c2a-422f-b22e-8d169c7a3614 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.813485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1177/2343] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:21.814559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb109-5c2a-422f-b22e-8d169c7a3614 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.838119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb109-5c2a-422f-b22e-8d169c7a3614 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.851291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b893-932e-4598-bebf-16412adbab3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.852278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b893-932e-4598-bebf-16412adbab3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.854776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b893-932e-4598-bebf-16412adbab3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.855186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b893-932e-4598-bebf-16412adbab3c admin admin] PATH_INFO: `/v3/projects/a2f76c99765545929ecfa61c83744251/users/c0c30714c207438bbfb96fb8c1435a4c/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.876772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b893-932e-4598-bebf-16412adbab3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f76c99765545929ecfa61c83744251, user_id=c0c30714c207438bbfb96fb8c1435a4c, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.879508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b893-932e-4598-bebf-16412adbab3c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.899046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651a9f1-3955-4a12-b57d-3e89f29d5c97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.900592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651a9f1-3955-4a12-b57d-3e89f29d5c97 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.914806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1167/2344] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:21 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:21.915952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651a9f1-3955-4a12-b57d-3e89f29d5c97 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:21.924845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651a9f1-3955-4a12-b57d-3e89f29d5c97 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:21.928968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11d095-f3aa-430b-bf4b-9411e469bdf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:21.929649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d095-f3aa-430b-bf4b-9411e469bdf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.929934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d095-f3aa-430b-bf4b-9411e469bdf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.930211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11d095-f3aa-430b-bf4b-9411e469bdf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:21.943697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11d095-f3aa-430b-bf4b-9411e469bdf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:21.945193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11d095-f3aa-430b-bf4b-9411e469bdf3 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:21.954888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1168/2345] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:21.977267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1178/2346] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:21 2022] PUT /identity/v3/projects/a2f76c99765545929ecfa61c83744251/users/c0c30714c207438bbfb96fb8c1435a4c/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:21.984709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:21.988688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bd949-82ef-463d-918f-d421d0cd9b6a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:21.989164 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bd949-82ef-463d-918f-d421d0cd9b6a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:21.989641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bd949-82ef-463d-918f-d421d0cd9b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.028235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-067bd949-82ef-463d-918f-d421d0cd9b6a None None] MFA Rules not processed for user `c0c30714c207438bbfb96fb8c1435a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:22.029493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-067bd949-82ef-463d-918f-d421d0cd9b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:22.129300 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1169/2347] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:22.134023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b893-932e-4598-bebf-16412adbab3c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:22.212861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b893-932e-4598-bebf-16412adbab3c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:22.219816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846a052-28b1-4a3b-9a84-7b7fe7cda969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:22.219816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846a052-28b1-4a3b-9a84-7b7fe7cda969 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.219816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846a052-28b1-4a3b-9a84-7b7fe7cda969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.219816 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846a052-28b1-4a3b-9a84-7b7fe7cda969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.223095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846a052-28b1-4a3b-9a84-7b7fe7cda969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:22.223095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846a052-28b1-4a3b-9a84-7b7fe7cda969 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:22.312748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1179/2348] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:22 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:22.318442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bd949-82ef-463d-918f-d421d0cd9b6a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:22.329873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bd949-82ef-463d-918f-d421d0cd9b6a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:22.338103 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:22.395332 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33def73-272f-46f1-837e-410b0a7c5a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:22.395991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33def73-272f-46f1-837e-410b0a7c5a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.396280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33def73-272f-46f1-837e-410b0a7c5a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.396559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33def73-272f-46f1-837e-410b0a7c5a6d admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.397200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33def73-272f-46f1-837e-410b0a7c5a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:22.399183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33def73-272f-46f1-837e-410b0a7c5a6d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:22.443347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171c4c9-c84f-410e-bf07-26ecc8903326 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.443669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171c4c9-c84f-410e-bf07-26ecc8903326 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.444856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171c4c9-c84f-410e-bf07-26ecc8903326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.464612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-8171c4c9-c84f-410e-bf07-26ecc8903326 None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:22.465819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8171c4c9-c84f-410e-bf07-26ecc8903326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:22.508241 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1170/2349] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:22 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:22.512345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33def73-272f-46f1-837e-410b0a7c5a6d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:22.521881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33def73-272f-46f1-837e-410b0a7c5a6d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:22.526952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb5f07-06d1-47d3-9c5c-c46a1d0650e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:22.527655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5f07-06d1-47d3-9c5c-c46a1d0650e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.527985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5f07-06d1-47d3-9c5c-c46a1d0650e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.528339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5f07-06d1-47d3-9c5c-c46a1d0650e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.529020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb5f07-06d1-47d3-9c5c-c46a1d0650e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:22.529206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1180/2350] 10.222.0.82 () {58 vars in 967 bytes} [Mon Aug 29 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:22.530747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb5f07-06d1-47d3-9c5c-c46a1d0650e5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:22.544529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1171/2351] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:19:22.544678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171c4c9-c84f-410e-bf07-26ecc8903326 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:22.545847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb5f07-06d1-47d3-9c5c-c46a1d0650e5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:22.557782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb5f07-06d1-47d3-9c5c-c46a1d0650e5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:22.562863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c96d9-2f89-4378-b720-de93e22d8a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:22.563470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c96d9-2f89-4378-b720-de93e22d8a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.563965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c96d9-2f89-4378-b720-de93e22d8a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.564247 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c96d9-2f89-4378-b720-de93e22d8a7c admin admin] PATH_INFO: `/v3/projects/6e61e29d488c4c49b99bef4d3bc1de8f/users/2593c9beffc0459db741f1c9d6928515/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.580428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c96d9-2f89-4378-b720-de93e22d8a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e61e29d488c4c49b99bef4d3bc1de8f, user_id=2593c9beffc0459db741f1c9d6928515, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:22.583145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c96d9-2f89-4378-b720-de93e22d8a7c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:22.632885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171c4c9-c84f-410e-bf07-26ecc8903326 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:22.639964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a86c-7ccc-48a5-8727-69381aaaabe6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:22.640623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a86c-7ccc-48a5-8727-69381aaaabe6 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.640923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a86c-7ccc-48a5-8727-69381aaaabe6 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.641219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a86c-7ccc-48a5-8727-69381aaaabe6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.650072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a86c-7ccc-48a5-8727-69381aaaabe6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:22.651653 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a86c-7ccc-48a5-8727-69381aaaabe6 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:22.660621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1181/2352] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:19:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 19:19:22.699821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1172/2353] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:22 2022] PUT /identity/v3/projects/6e61e29d488c4c49b99bef4d3bc1de8f/users/2593c9beffc0459db741f1c9d6928515/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:22.709786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a86c-7ccc-48a5-8727-69381aaaabe6 service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:22.725741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a86c-7ccc-48a5-8727-69381aaaabe6 service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:22.784270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c96d9-2f89-4378-b720-de93e22d8a7c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:22.832979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d97e4b-51d6-44fb-9dbc-6c1a3f0daa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:22.833518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d97e4b-51d6-44fb-9dbc-6c1a3f0daa4f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.833804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d97e4b-51d6-44fb-9dbc-6c1a3f0daa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.834082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d97e4b-51d6-44fb-9dbc-6c1a3f0daa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.834734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d97e4b-51d6-44fb-9dbc-6c1a3f0daa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:22.836442 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d97e4b-51d6-44fb-9dbc-6c1a3f0daa4f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:22.847304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1182/2354] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:22.848368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d97e4b-51d6-44fb-9dbc-6c1a3f0daa4f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:22.854668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c96d9-2f89-4378-b720-de93e22d8a7c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:22.858479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562745a8-18d4-42cb-aad5-26f7b979accc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:22.859095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562745a8-18d4-42cb-aad5-26f7b979accc service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.859376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562745a8-18d4-42cb-aad5-26f7b979accc service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.859647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562745a8-18d4-42cb-aad5-26f7b979accc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.861082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d97e4b-51d6-44fb-9dbc-6c1a3f0daa4f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:22.861430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-562745a8-18d4-42cb-aad5-26f7b979accc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:22.864868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:22.865503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:22.865790 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:22.866068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:22.867896 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:22.989412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562745a8-18d4-42cb-aad5-26f7b979accc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:22.989753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:22.990883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:22.991027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562745a8-18d4-42cb-aad5-26f7b979accc service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:23.000927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1183/2355] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:23.001674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:23.003828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1173/2356] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:23.013201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85804c47-39fd-4f81-a266-ca87f6aba7d6 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:23.021834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fa8ff-8e6b-4999-84fe-7e0c0ea22e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:23.022647 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa8ff-8e6b-4999-84fe-7e0c0ea22e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:23.022940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa8ff-8e6b-4999-84fe-7e0c0ea22e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:23.023290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fa8ff-8e6b-4999-84fe-7e0c0ea22e2d admin admin] PATH_INFO: `/v3/projects/6e61e29d488c4c49b99bef4d3bc1de8f/users/2593c9beffc0459db741f1c9d6928515/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:23.027441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fa8ff-8e6b-4999-84fe-7e0c0ea22e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e61e29d488c4c49b99bef4d3bc1de8f, user_id=2593c9beffc0459db741f1c9d6928515, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:23.030524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932fa8ff-8e6b-4999-84fe-7e0c0ea22e2d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:23.045458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1184/2357] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:23 2022] PUT /identity/v3/projects/6e61e29d488c4c49b99bef4d3bc1de8f/users/2593c9beffc0459db741f1c9d6928515/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:23.057187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c8393-d40a-4b3a-86e2-a4f290c12111 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:23.057522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c8393-d40a-4b3a-86e2-a4f290c12111 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:23.057751 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c8393-d40a-4b3a-86e2-a4f290c12111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:23.087674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3d2c8393-d40a-4b3a-86e2-a4f290c12111 None None] MFA Rules not processed for user `2593c9beffc0459db741f1c9d6928515`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:23.089325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3d2c8393-d40a-4b3a-86e2-a4f290c12111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:23.173146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1174/2358] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:23.508404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fa8ff-8e6b-4999-84fe-7e0c0ea22e2d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:23.595097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fa8ff-8e6b-4999-84fe-7e0c0ea22e2d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:23.601733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:23.603882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:23.603882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:23.603882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:23.605126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:23.657107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2645b0-7846-49ca-9d5e-ade7a22201c4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:23.658093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2645b0-7846-49ca-9d5e-ade7a22201c4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:23.658588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2645b0-7846-49ca-9d5e-ade7a22201c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:23.685918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-ef2645b0-7846-49ca-9d5e-ade7a22201c4 None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:23.687317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ef2645b0-7846-49ca-9d5e-ade7a22201c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:23.699719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:23.701435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:23.712531 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1185/2359] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:23.731869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:23.741279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dc9a4-296e-40b4-b080-8f543a7a60c0 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:23.747382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc3ec-426a-4b11-80ca-406eee7e9d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:23.748173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc3ec-426a-4b11-80ca-406eee7e9d9b service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:23.748454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc3ec-426a-4b11-80ca-406eee7e9d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:23.748973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cc3ec-426a-4b11-80ca-406eee7e9d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:23.761411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cc3ec-426a-4b11-80ca-406eee7e9d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:23.763712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cc3ec-426a-4b11-80ca-406eee7e9d9b service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:23.790967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1186/2360] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:23.806927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1175/2361] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:23.827159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc3ec-426a-4b11-80ca-406eee7e9d9b service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:23.946873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cc3ec-426a-4b11-80ca-406eee7e9d9b service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:23.953713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9d8c-237b-4c1b-9176-99847e343ae3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:23.954366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9d8c-237b-4c1b-9176-99847e343ae3 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:23.961074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9d8c-237b-4c1b-9176-99847e343ae3 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:23.961074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9d8c-237b-4c1b-9176-99847e343ae3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:23.965695 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9d8c-237b-4c1b-9176-99847e343ae3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:23.967851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9d8c-237b-4c1b-9176-99847e343ae3 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:23.976682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1187/2362] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:19:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 19:19:24.018104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:24.520423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:25.010075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1eb2d-2f9e-4bf2-b4a0-cf15575410d5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:25.010075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1eb2d-2f9e-4bf2-b4a0-cf15575410d5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:25.010075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1eb2d-2f9e-4bf2-b4a0-cf15575410d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:25.031902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-92c1eb2d-2f9e-4bf2-b4a0-cf15575410d5 None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:25.032221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-92c1eb2d-2f9e-4bf2-b4a0-cf15575410d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:25.041521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1176/2363] 10.222.0.82 () {58 vars in 967 bytes} [Mon Aug 29 19:19:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:25.071235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9d8c-237b-4c1b-9176-99847e343ae3 service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:25.086095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9d8c-237b-4c1b-9176-99847e343ae3 service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:25.091708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff24cf-deb5-4480-a1ff-ca43ec96da9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:25.092225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff24cf-deb5-4480-a1ff-ca43ec96da9a service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:25.092505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff24cf-deb5-4480-a1ff-ca43ec96da9a service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:25.094302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff24cf-deb5-4480-a1ff-ca43ec96da9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:25.102881 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff24cf-deb5-4480-a1ff-ca43ec96da9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:25.104494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff24cf-deb5-4480-a1ff-ca43ec96da9a service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:25.113576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1188/2364] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:19:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:19:25.243332 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1eb2d-2f9e-4bf2-b4a0-cf15575410d5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:25.256997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1eb2d-2f9e-4bf2-b4a0-cf15575410d5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:25.260810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549f44c-4d6e-4ce7-900e-0f430050eb17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:25.261434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549f44c-4d6e-4ce7-900e-0f430050eb17 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:25.261713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549f44c-4d6e-4ce7-900e-0f430050eb17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:25.261986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549f44c-4d6e-4ce7-900e-0f430050eb17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:25.330641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549f44c-4d6e-4ce7-900e-0f430050eb17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:25.332161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549f44c-4d6e-4ce7-900e-0f430050eb17 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:25.341510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1177/2365] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:25.600150 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:26.211605 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:26.340494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff24cf-deb5-4480-a1ff-ca43ec96da9a service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:26.441112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff24cf-deb5-4480-a1ff-ca43ec96da9a service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:26.449565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:26.450269 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:26.450548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:26.450887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] PATH_INFO: `/v3/users/c0c30714c207438bbfb96fb8c1435a4c` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:26.452333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c30714c207438bbfb96fb8c1435a4c)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:26.455546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:26.708939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c30714c207438bbfb96fb8c1435a4c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:26.811633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c30714c207438bbfb96fb8c1435a4c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:26.812380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c30714c207438bbfb96fb8c1435a4c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:26.832350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c30714c207438bbfb96fb8c1435a4c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:26.833091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c30714c207438bbfb96fb8c1435a4c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:26.854138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1189/2366] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:26 2022] DELETE /identity/v3/users/c0c30714c207438bbfb96fb8c1435a4c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:26.858707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75805-e688-4372-b585-b2fe06af773b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:26.859228 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75805-e688-4372-b585-b2fe06af773b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:26.859319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75805-e688-4372-b585-b2fe06af773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:26.879870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-38c75805-e688-4372-b585-b2fe06af773b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:26.881097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-38c75805-e688-4372-b585-b2fe06af773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:26.965785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1178/2367] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:26.991675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:26.991675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:27.053993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cb837-e13e-49aa-aa07-6f96229e67db admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:27.061755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:27.062469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:27.062738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:27.063119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:27.078044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:27.080415 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:27.100661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1190/2368] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:27.195176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:27.601282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75805-e688-4372-b585-b2fe06af773b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:27.603499 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-38c75805-e688-4372-b585-b2fe06af773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:27.617371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c75805-e688-4372-b585-b2fe06af773b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:27.623064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:27.623877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:27.624239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:27.624592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] PATH_INFO: `/v3/projects/a2f76c99765545929ecfa61c83744251` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:27.625838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f76c99765545929ecfa61c83744251)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:27.628092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:27.749813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f76c99765545929ecfa61c83744251', 'request_id': 'req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:27.844931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f76c99765545929ecfa61c83744251', 'request_id': 'req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:27.850592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:27.853298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:27.855795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f76c99765545929ecfa61c83744251', 'request_id': 'req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:27.883658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] The token cache is being invalidate because project a2f76c99765545929ecfa61c83744251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:27.884498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:27.886229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:27.890465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1179/2369] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:27 2022] DELETE /identity/v3/projects/a2f76c99765545929ecfa61c83744251 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:27.895042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:27.896770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:27.905716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4fbd7-83fe-4923-9839-d81df243112c service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:27.978137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab7a2-28e5-47d9-b8ea-dd8952cb7d84 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:27.984344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:27.985382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:27.985961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:27.986405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] PATH_INFO: `/v3/users/2593c9beffc0459db741f1c9d6928515` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:27.991445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2593c9beffc0459db741f1c9d6928515)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:27.993420 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:28.040838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:28.042364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:28.042652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:28.042935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] PATH_INFO: `/v3/users/f692f780705643a09f13ac90721f1835` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:28.044270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f692f780705643a09f13ac90721f1835)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:28.046367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:28.272619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2593c9beffc0459db741f1c9d6928515'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.273722 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2593c9beffc0459db741f1c9d6928515'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.284510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f692f780705643a09f13ac90721f1835'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.371911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2593c9beffc0459db741f1c9d6928515'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.372898 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2593c9beffc0459db741f1c9d6928515'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.389181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b568900c-a048-42d5-9cda-fe9a7f8b6f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2593c9beffc0459db741f1c9d6928515'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.410450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:28.412726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1180/2370] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:27 2022] DELETE /identity/v3/users/2593c9beffc0459db741f1c9d6928515 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:28.468330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f692f780705643a09f13ac90721f1835'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.469292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f692f780705643a09f13ac90721f1835'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.488407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f692f780705643a09f13ac90721f1835'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.489277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f692f780705643a09f13ac90721f1835'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:28.507665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1191/2371] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:27 2022] DELETE /identity/v3/users/f692f780705643a09f13ac90721f1835 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:28.509894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9a58-fb4e-4ba1-ba9f-fadd60b0ba96 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:28.510282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9a58-fb4e-4ba1-ba9f-fadd60b0ba96 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:28.510781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a9a58-fb4e-4ba1-ba9f-fadd60b0ba96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:28.539712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-992a9a58-fb4e-4ba1-ba9f-fadd60b0ba96 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:28.539712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-992a9a58-fb4e-4ba1-ba9f-fadd60b0ba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:28.630408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1181/2372] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:28.664153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:28.665988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:28.675992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:28.809825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bb44d-edab-46b9-82b1-15143ef9500b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:28.814408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def3388-5411-4596-92d6-53e05e01b026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:28.815119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def3388-5411-4596-92d6-53e05e01b026 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:28.816083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def3388-5411-4596-92d6-53e05e01b026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:28.816566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def3388-5411-4596-92d6-53e05e01b026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:28.826952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def3388-5411-4596-92d6-53e05e01b026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:28.828962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def3388-5411-4596-92d6-53e05e01b026 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:28.843796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1192/2373] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:28.982419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9a58-fb4e-4ba1-ba9f-fadd60b0ba96 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:28.984029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-992a9a58-fb4e-4ba1-ba9f-fadd60b0ba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:29.000831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a9a58-fb4e-4ba1-ba9f-fadd60b0ba96 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:29.008145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:29.009102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:29.009639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:29.010524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] PATH_INFO: `/v3/projects/6e61e29d488c4c49b99bef4d3bc1de8f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:29.012305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e61e29d488c4c49b99bef4d3bc1de8f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:29.014707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:29.169278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e61e29d488c4c49b99bef4d3bc1de8f', 'request_id': 'req-a8aec702-5a33-4f8f-98aa-2dabcb46d381'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.292325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e61e29d488c4c49b99bef4d3bc1de8f', 'request_id': 'req-a8aec702-5a33-4f8f-98aa-2dabcb46d381'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.302587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e61e29d488c4c49b99bef4d3bc1de8f', 'request_id': 'req-a8aec702-5a33-4f8f-98aa-2dabcb46d381'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.323893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] The token cache is being invalidate because project 6e61e29d488c4c49b99bef4d3bc1de8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:29.324431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.325881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a8aec702-5a33-4f8f-98aa-2dabcb46d381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.332576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1182/2374] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:28 2022] DELETE /identity/v3/projects/6e61e29d488c4c49b99bef4d3bc1de8f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:29.333856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d02a-e790-4115-9ea0-4cb519f15985 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:29.334302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d02a-e790-4115-9ea0-4cb519f15985 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:29.334450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171d02a-e790-4115-9ea0-4cb519f15985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:29.363991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a171d02a-e790-4115-9ea0-4cb519f15985 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:29.366061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a171d02a-e790-4115-9ea0-4cb519f15985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:29.471942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1193/2375] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:29.472065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe9ac-a0e8-46b4-81e1-cf6999ebd590 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:29.472065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe9ac-a0e8-46b4-81e1-cf6999ebd590 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:29.472065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffe9ac-a0e8-46b4-81e1-cf6999ebd590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:29.501667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f1ffe9ac-a0e8-46b4-81e1-cf6999ebd590 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:29.502945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f1ffe9ac-a0e8-46b4-81e1-cf6999ebd590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:29.518645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d02a-e790-4115-9ea0-4cb519f15985 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:29.521566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a171d02a-e790-4115-9ea0-4cb519f15985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:29.528304 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1183/2376] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:29.531848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe9ac-a0e8-46b4-81e1-cf6999ebd590 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:29.551469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171d02a-e790-4115-9ea0-4cb519f15985 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:29.558112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:29.558349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffe9ac-a0e8-46b4-81e1-cf6999ebd590 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:29.558811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:29.559181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:29.559493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] PATH_INFO: `/v3/projects/0d3834cbff0c4fba9b101ebe799be5c8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:29.561189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3834cbff0c4fba9b101ebe799be5c8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:29.563641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:29.564063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:29.564301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:29.564588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:29.565459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:29.566823 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:29.567269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:29.569021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:29.585205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1184/2377] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:29.590265 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:29.604202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50de72c-a99d-4dd2-9a6f-6ca8bf1fd664 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:29.611125 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe83ff5-c164-493a-95ad-16ac9f1151c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:29.611125 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83ff5-c164-493a-95ad-16ac9f1151c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:29.611125 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83ff5-c164-493a-95ad-16ac9f1151c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:29.611125 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe83ff5-c164-493a-95ad-16ac9f1151c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:29.613290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe83ff5-c164-493a-95ad-16ac9f1151c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:29.614109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe83ff5-c164-493a-95ad-16ac9f1151c1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:29.714885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3834cbff0c4fba9b101ebe799be5c8', 'request_id': 'req-92e5a731-d4a3-4a95-84e0-8153f0d163f7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.745463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1185/2378] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:29 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:29.746571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe83ff5-c164-493a-95ad-16ac9f1151c1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:29.772504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3834cbff0c4fba9b101ebe799be5c8', 'request_id': 'req-92e5a731-d4a3-4a95-84e0-8153f0d163f7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.776987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3834cbff0c4fba9b101ebe799be5c8', 'request_id': 'req-92e5a731-d4a3-4a95-84e0-8153f0d163f7'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.789794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] The token cache is being invalidate because project 0d3834cbff0c4fba9b101ebe799be5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:29.790164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.790966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:29.792665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1194/2379] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:29 2022] DELETE /identity/v3/projects/0d3834cbff0c4fba9b101ebe799be5c8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:29.802639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:29.804883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:29.858662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe83ff5-c164-493a-95ad-16ac9f1151c1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:29.866303 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:29.867179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:29.867527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:29.868027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:29.868789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:29.870858 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:29.925403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5a731-d4a3-4a95-84e0-8153f0d163f7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:29.937808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:29.942458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:29.942458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:29.942458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] PATH_INFO: `/v3/users/f9dc1a8e6a0c464ca23ce37ca499d561` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:29.942458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dc1a8e6a0c464ca23ce37ca499d561)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:29.943513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:29.967325 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:29.990070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1186/2380] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:29 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:29.991124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:30.000490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:30.020457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c64a06-b9fc-43ab-b597-fd36c0051024 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:30.029936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc61d-0ea4-4823-8f12-d1616418e796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:30.040037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc61d-0ea4-4823-8f12-d1616418e796 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:30.040037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc61d-0ea4-4823-8f12-d1616418e796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:30.040037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc61d-0ea4-4823-8f12-d1616418e796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:30.040037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fc61d-0ea4-4823-8f12-d1616418e796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:30.040037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fc61d-0ea4-4823-8f12-d1616418e796 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:30.060595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1187/2381] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:30.073078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc61d-0ea4-4823-8f12-d1616418e796 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:30.099254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc61d-0ea4-4823-8f12-d1616418e796 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:30.106912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33f71-4c09-46e3-bfce-40f6b8631e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:30.107556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33f71-4c09-46e3-bfce-40f6b8631e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:30.107891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33f71-4c09-46e3-bfce-40f6b8631e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:30.108498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf33f71-4c09-46e3-bfce-40f6b8631e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:30.109214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf33f71-4c09-46e3-bfce-40f6b8631e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:30.111044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf33f71-4c09-46e3-bfce-40f6b8631e32 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:30.141439 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1188/2382] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:30.146677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33f71-4c09-46e3-bfce-40f6b8631e32 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:30.159186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dc1a8e6a0c464ca23ce37ca499d561'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:30.161378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf33f71-4c09-46e3-bfce-40f6b8631e32 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:30.166965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:30.167681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:30.167994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:30.168289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] PATH_INFO: `/v3/projects/fdad06cb6c9a429c83463a26cebd57db/users/309b830ddcf845869ad25a327498011e/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:30.200143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdad06cb6c9a429c83463a26cebd57db, user_id=309b830ddcf845869ad25a327498011e, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:30.202596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:30.251545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dc1a8e6a0c464ca23ce37ca499d561'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:30.252656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dc1a8e6a0c464ca23ce37ca499d561'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:30.268040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dc1a8e6a0c464ca23ce37ca499d561'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:30.268844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-65990455-a323-43f5-8b6f-94b3427af713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dc1a8e6a0c464ca23ce37ca499d561'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:30.284144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1195/2383] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:29 2022] DELETE /identity/v3/users/f9dc1a8e6a0c464ca23ce37ca499d561 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:30.355402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1189/2384] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:30 2022] PUT /identity/v3/projects/fdad06cb6c9a429c83463a26cebd57db/users/309b830ddcf845869ad25a327498011e/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:30.358559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0517-bc8e-481c-a608-b5a88998b60a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:30.359096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0517-bc8e-481c-a608-b5a88998b60a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:30.360130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0517-bc8e-481c-a608-b5a88998b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:30.402146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d2ac0517-bc8e-481c-a608-b5a88998b60a None None] MFA Rules not processed for user `309b830ddcf845869ad25a327498011e`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:30.403673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d2ac0517-bc8e-481c-a608-b5a88998b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:30.566629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1196/2385] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:30.571805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:30.574912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:30.656562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:30.716135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c8b55-535b-4811-82fa-fcb56260369b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:30.728147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:30.729128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:30.731769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:30.746167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:30.746167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:30.746167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:30.835601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1190/2386] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:30 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:30.839804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac0517-bc8e-481c-a608-b5a88998b60a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:30.851504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac0517-bc8e-481c-a608-b5a88998b60a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:30.868253 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:30.871094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:30.962284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d688aa-bc45-444f-93a4-2ae3de02f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:30.962904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d688aa-bc45-444f-93a4-2ae3de02f713 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:30.963187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d688aa-bc45-444f-93a4-2ae3de02f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:30.963464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d688aa-bc45-444f-93a4-2ae3de02f713 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:30.964417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d688aa-bc45-444f-93a4-2ae3de02f713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:30.966412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d688aa-bc45-444f-93a4-2ae3de02f713 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:30.988839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52945ecb-0d3b-4a55-a7f3-302b007f98cc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:30.988839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:30.988839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:30.988839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:30.989159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] PATH_INFO: `/v3/projects/ae65f03d1be440529da45628e806c142` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:30.989159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae65f03d1be440529da45628e806c142)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:30.989159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.057806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:31.104649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1197/2387] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:30 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:31.107958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d688aa-bc45-444f-93a4-2ae3de02f713 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.118403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d688aa-bc45-444f-93a4-2ae3de02f713 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.138424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae65f03d1be440529da45628e806c142', 'request_id': 'req-6389d2b2-e15e-4f00-8745-76fe65b428f0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.189611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.190411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.191323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.191914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.192348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:31.194571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.204680 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1198/2388] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:31.205592 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.210736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.218043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae65f03d1be440529da45628e806c142', 'request_id': 'req-6389d2b2-e15e-4f00-8745-76fe65b428f0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.227444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32f023-3f28-44cd-a356-859ee03cfe80 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.230502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae65f03d1be440529da45628e806c142', 'request_id': 'req-6389d2b2-e15e-4f00-8745-76fe65b428f0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.233154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.233832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.234114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.234390 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] PATH_INFO: `/v3/users/995ebc000bd446debd0d1a08080af5bf` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.235608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=995ebc000bd446debd0d1a08080af5bf)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:31.238022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.242360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] The token cache is being invalidate because project ae65f03d1be440529da45628e806c142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:31.242934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.243824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.245441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1191/2389] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:30 2022] DELETE /identity/v3/projects/ae65f03d1be440529da45628e806c142 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:31.246437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.248104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.264278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389d2b2-e15e-4f00-8745-76fe65b428f0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.270198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b72bd-7480-47f9-bc44-ed89191c71a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.270868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72bd-7480-47f9-bc44-ed89191c71a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.271157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72bd-7480-47f9-bc44-ed89191c71a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.271484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72bd-7480-47f9-bc44-ed89191c71a5 admin admin] PATH_INFO: `/v3/projects/13ad037210f345a4bdc07b75a47f4842/users/54f03877b7194a77820cc56b96d67dcc/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.287052 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b72bd-7480-47f9-bc44-ed89191c71a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ad037210f345a4bdc07b75a47f4842, user_id=54f03877b7194a77820cc56b96d67dcc, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:31.289915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b72bd-7480-47f9-bc44-ed89191c71a5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.395178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1192/2390] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:31 2022] PUT /identity/v3/projects/13ad037210f345a4bdc07b75a47f4842/users/54f03877b7194a77820cc56b96d67dcc/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:31.396503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6309-47c0-4268-8a84-ed17fbea2b01 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.396786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6309-47c0-4268-8a84-ed17fbea2b01 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.397058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6309-47c0-4268-8a84-ed17fbea2b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.417765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-698e6309-47c0-4268-8a84-ed17fbea2b01 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:31.419049 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-698e6309-47c0-4268-8a84-ed17fbea2b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.433225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995ebc000bd446debd0d1a08080af5bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.485403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1193/2391] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:31.485403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6309-47c0-4268-8a84-ed17fbea2b01 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.498459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995ebc000bd446debd0d1a08080af5bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.498640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6309-47c0-4268-8a84-ed17fbea2b01 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.500293 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995ebc000bd446debd0d1a08080af5bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.504724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45bfb5-5b4f-485e-ab5a-cf3c2fb8adfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.505348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45bfb5-5b4f-485e-ab5a-cf3c2fb8adfa admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.505626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45bfb5-5b4f-485e-ab5a-cf3c2fb8adfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.505896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45bfb5-5b4f-485e-ab5a-cf3c2fb8adfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.506583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45bfb5-5b4f-485e-ab5a-cf3c2fb8adfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:31.508212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45bfb5-5b4f-485e-ab5a-cf3c2fb8adfa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.519265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995ebc000bd446debd0d1a08080af5bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.524589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1194/2392] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:31.524949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995ebc000bd446debd0d1a08080af5bf'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:31.525115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb8e8-ca5b-4693-bee3-37dbad37e7e1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.525115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb8e8-ca5b-4693-bee3-37dbad37e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.525115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bb8e8-ca5b-4693-bee3-37dbad37e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.546379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1199/2393] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:31 2022] DELETE /identity/v3/users/995ebc000bd446debd0d1a08080af5bf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:31.546379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.546379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.547937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e02bb8e8-ca5b-4693-bee3-37dbad37e7e1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:31.549185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e02bb8e8-ca5b-4693-bee3-37dbad37e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.614461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1195/2394] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:31.615576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501833e-dac2-4649-902a-a9ecec1ec84c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.615926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501833e-dac2-4649-902a-a9ecec1ec84c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.616100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaf3fb-a3a1-4202-8b95-940c9cdc44e8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.616206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501833e-dac2-4649-902a-a9ecec1ec84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.621574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554b9dc-5905-480a-8160-e57453b151b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.622251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554b9dc-5905-480a-8160-e57453b151b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.622539 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554b9dc-5905-480a-8160-e57453b151b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.622822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554b9dc-5905-480a-8160-e57453b151b5 admin admin] PATH_INFO: `/v3/projects/13ad037210f345a4bdc07b75a47f4842/users/54f03877b7194a77820cc56b96d67dcc/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.624976 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554b9dc-5905-480a-8160-e57453b151b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ad037210f345a4bdc07b75a47f4842, user_id=54f03877b7194a77820cc56b96d67dcc, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:31.627629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554b9dc-5905-480a-8160-e57453b151b5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.638899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-4501833e-dac2-4649-902a-a9ecec1ec84c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:31.640141 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4501833e-dac2-4649-902a-a9ecec1ec84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.650652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1200/2395] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:31 2022] PUT /identity/v3/projects/13ad037210f345a4bdc07b75a47f4842/users/54f03877b7194a77820cc56b96d67dcc/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:31.652062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554b9dc-5905-480a-8160-e57453b151b5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.708844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1196/2396] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:31.710324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa27f-d26b-49ed-b482-caba53e7358b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.710606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa27f-d26b-49ed-b482-caba53e7358b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.710882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaa27f-d26b-49ed-b482-caba53e7358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.754169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-dedaa27f-d26b-49ed-b482-caba53e7358b None None] MFA Rules not processed for user `54f03877b7194a77820cc56b96d67dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:31.755513 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-dedaa27f-d26b-49ed-b482-caba53e7358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.757162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554b9dc-5905-480a-8160-e57453b151b5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.764521 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.765262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.767603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.767603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.767603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:31.767603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:31.770383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.784354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1201/2397] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:31.785484 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.787641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.811977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:31.865542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1197/2398] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:31.866517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaa27f-d26b-49ed-b482-caba53e7358b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.869882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c64f05-400a-4198-af62-3b527225c684 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.877848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.878706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.879214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.879491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.888647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaa27f-d26b-49ed-b482-caba53e7358b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.889625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:31.891270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.898363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982dfd-73c8-4b9f-b77e-d9377297a91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.898363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982dfd-73c8-4b9f-b77e-d9377297a91e admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.898363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982dfd-73c8-4b9f-b77e-d9377297a91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.898786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982dfd-73c8-4b9f-b77e-d9377297a91e admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.899176 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d982dfd-73c8-4b9f-b77e-d9377297a91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:31.901675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d982dfd-73c8-4b9f-b77e-d9377297a91e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:31.908755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1202/2399] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:31.910911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:31.913383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:31.982045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857fcba-5e9e-4d6b-a514-d66c80def946 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:31.985831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:31.986536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:31.986888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:31.987229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:31.990196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:32.019356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1198/2400] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:32.024302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982dfd-73c8-4b9f-b77e-d9377297a91e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:32.088086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:32.089663 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:32.114331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982dfd-73c8-4b9f-b77e-d9377297a91e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:32.120334 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f57e-4947-40c6-8933-e786849f7f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:32.120718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1203/2401] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:32.121243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f57e-4947-40c6-8933-e786849f7f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.121652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f57e-4947-40c6-8933-e786849f7f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.121997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f57e-4947-40c6-8933-e786849f7f86 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:32.127031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172f57e-4947-40c6-8933-e786849f7f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:32.127031 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172f57e-4947-40c6-8933-e786849f7f86 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:32.252019 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1199/2402] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:32 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:32.256667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:32.268205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ab20c-74ce-449d-b49f-0714f83739f1 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:32.273278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f940f6-b3fb-4fad-8fc9-76e37b5685b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:32.273911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f940f6-b3fb-4fad-8fc9-76e37b5685b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.274177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f940f6-b3fb-4fad-8fc9-76e37b5685b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.274449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f940f6-b3fb-4fad-8fc9-76e37b5685b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:32.275099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f940f6-b3fb-4fad-8fc9-76e37b5685b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:32.276708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f940f6-b3fb-4fad-8fc9-76e37b5685b1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:32.287662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1204/2403] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:32.292041 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f57e-4947-40c6-8933-e786849f7f86 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:32.303630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f57e-4947-40c6-8933-e786849f7f86 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:32.309996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:32.310665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.310951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.311230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:32.311977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:32.313674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:32.335815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1200/2404] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:32.340590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f940f6-b3fb-4fad-8fc9-76e37b5685b1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:32.354262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:32.356922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:32.364080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f940f6-b3fb-4fad-8fc9-76e37b5685b1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:32.380796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2ab4d-8552-4f3f-897a-ce6e5d77de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:32.381423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ab4d-8552-4f3f-897a-ce6e5d77de21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.381704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ab4d-8552-4f3f-897a-ce6e5d77de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.381983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2ab4d-8552-4f3f-897a-ce6e5d77de21 admin admin] PATH_INFO: `/v3/projects/580fffff66a1442eb22428bbd9ed9c9d/users/75a9c3f0bbff4b8da895d237f98480ff/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:32.396833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d63dfc-7e69-4ab4-b364-4158245b1a3f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:32.403195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:32.403911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.404207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.404486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] PATH_INFO: `/v3/projects/e3cbe9f775e34ba3bf05429e9d2916f4` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:32.405696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3cbe9f775e34ba3bf05429e9d2916f4)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:32.407862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:32.410458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:32.424330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2ab4d-8552-4f3f-897a-ce6e5d77de21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580fffff66a1442eb22428bbd9ed9c9d, user_id=75a9c3f0bbff4b8da895d237f98480ff, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:32.428003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2ab4d-8552-4f3f-897a-ce6e5d77de21 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:32.637968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1205/2405] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:32 2022] PUT /identity/v3/projects/580fffff66a1442eb22428bbd9ed9c9d/users/75a9c3f0bbff4b8da895d237f98480ff/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:32.658338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d13c6-7897-4d15-8038-0dbcc7e4c4a3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.661744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d13c6-7897-4d15-8038-0dbcc7e4c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.662501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d13c6-7897-4d15-8038-0dbcc7e4c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:32.669464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3cbe9f775e34ba3bf05429e9d2916f4', 'request_id': 'req-2056b7f4-fc4f-48fc-851e-a716260ebb4b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:32.732909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-997d13c6-7897-4d15-8038-0dbcc7e4c4a3 None None] MFA Rules not processed for user `75a9c3f0bbff4b8da895d237f98480ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:32.734295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-997d13c6-7897-4d15-8038-0dbcc7e4c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:32.802827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:32.829353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1206/2406] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:32.833913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d13c6-7897-4d15-8038-0dbcc7e4c4a3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:32.862953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3cbe9f775e34ba3bf05429e9d2916f4', 'request_id': 'req-2056b7f4-fc4f-48fc-851e-a716260ebb4b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:32.872412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3cbe9f775e34ba3bf05429e9d2916f4', 'request_id': 'req-2056b7f4-fc4f-48fc-851e-a716260ebb4b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:32.884437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] The token cache is being invalidate because project e3cbe9f775e34ba3bf05429e9d2916f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:32.884920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:32.885879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2056b7f4-fc4f-48fc-851e-a716260ebb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:32.887427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1201/2407] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:32 2022] DELETE /identity/v3/projects/e3cbe9f775e34ba3bf05429e9d2916f4 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:32.895979 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122efbff-1411-4052-9d06-3283708730ba None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.896317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122efbff-1411-4052-9d06-3283708730ba None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.896591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122efbff-1411-4052-9d06-3283708730ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:32.912684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d13c6-7897-4d15-8038-0dbcc7e4c4a3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:32.918866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fb7ff-93bd-4566-a434-13d5004455af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:32.919481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fb7ff-93bd-4566-a434-13d5004455af admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.919756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fb7ff-93bd-4566-a434-13d5004455af admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.920062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fb7ff-93bd-4566-a434-13d5004455af admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:32.921500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fb7ff-93bd-4566-a434-13d5004455af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:32.925905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fb7ff-93bd-4566-a434-13d5004455af admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:32.958909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-122efbff-1411-4052-9d06-3283708730ba None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:32.960524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-122efbff-1411-4052-9d06-3283708730ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:32.980524 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1202/2408] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:32.982198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72d52c-5019-4e7c-a905-de1929ae2af1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:32.982569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72d52c-5019-4e7c-a905-de1929ae2af1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:32.983030 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72d52c-5019-4e7c-a905-de1929ae2af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.009239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6c72d52c-5019-4e7c-a905-de1929ae2af1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:33.011089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6c72d52c-5019-4e7c-a905-de1929ae2af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:33.023446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1203/2409] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:33.023446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72d52c-5019-4e7c-a905-de1929ae2af1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:33.023446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6c72d52c-5019-4e7c-a905-de1929ae2af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:33.039202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72d52c-5019-4e7c-a905-de1929ae2af1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:33.044796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:33.045498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.045777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.046057 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] PATH_INFO: `/v3/users/7990de81ebf64aaeb6c44dfd10a9555e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.047277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7990de81ebf64aaeb6c44dfd10a9555e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:33.049417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:33.088997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1207/2410] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:32 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:33.088997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fb7ff-93bd-4566-a434-13d5004455af admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:33.179583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fb7ff-93bd-4566-a434-13d5004455af admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:33.188688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:33.189716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.190226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.191268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.192487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:33.193045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:33.196141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:33.217298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1208/2411] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:33.218316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:33.220154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:33.233802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f3586-e864-4fc7-917c-75ad77cc4946 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:33.238668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:33.239272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.239555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.239861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.240499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:33.242406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:33.374197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7990de81ebf64aaeb6c44dfd10a9555e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:33.374977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7990de81ebf64aaeb6c44dfd10a9555e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:33.383194 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1209/2412] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:33 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:33.384222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:33.390797 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:33.424530 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4e883-7810-4d55-bcfc-beb45ebf5148 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:33.432178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feb5d8-8a85-41d9-932a-8c1ab656fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:33.432814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feb5d8-8a85-41d9-932a-8c1ab656fe66 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.433588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feb5d8-8a85-41d9-932a-8c1ab656fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.433873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feb5d8-8a85-41d9-932a-8c1ab656fe66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.435132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feb5d8-8a85-41d9-932a-8c1ab656fe66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:33.439778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feb5d8-8a85-41d9-932a-8c1ab656fe66 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:33.482592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7990de81ebf64aaeb6c44dfd10a9555e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:33.483547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7990de81ebf64aaeb6c44dfd10a9555e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:33.501017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7990de81ebf64aaeb6c44dfd10a9555e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:33.515836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1204/2413] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:33 2022] DELETE /identity/v3/users/7990de81ebf64aaeb6c44dfd10a9555e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:33.516902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:33.518462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:33.576628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1210/2414] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:33 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:33.584289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05197e44-fc15-4998-97fa-6e619067a672 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.584582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05197e44-fc15-4998-97fa-6e619067a672 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.584860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05197e44-fc15-4998-97fa-6e619067a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.613825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538a57c-badf-4873-9525-3a8039823085 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:33.625719 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-05197e44-fc15-4998-97fa-6e619067a672 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:33.632052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-05197e44-fc15-4998-97fa-6e619067a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:33.700673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1c9a-23b9-4839-b0c6-4b60a7a87a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:33.701495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1c9a-23b9-4839-b0c6-4b60a7a87a65 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.701784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1c9a-23b9-4839-b0c6-4b60a7a87a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.702063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f1c9a-23b9-4839-b0c6-4b60a7a87a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.703014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f1c9a-23b9-4839-b0c6-4b60a7a87a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:33.704427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f1c9a-23b9-4839-b0c6-4b60a7a87a65 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:33.723768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1205/2415] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:33.723768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1c9a-23b9-4839-b0c6-4b60a7a87a65 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:33.735777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1211/2416] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:33.735777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05197e44-fc15-4998-97fa-6e619067a672 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:33.735777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-05197e44-fc15-4998-97fa-6e619067a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:33.745970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f1c9a-23b9-4839-b0c6-4b60a7a87a65 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:33.750843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f5d4c-92de-4a23-840d-eca45d5cf642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:33.751465 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5d4c-92de-4a23-840d-eca45d5cf642 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.751775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5d4c-92de-4a23-840d-eca45d5cf642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.752554 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f5d4c-92de-4a23-840d-eca45d5cf642 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.753857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5d4c-92de-4a23-840d-eca45d5cf642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:33.756225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05197e44-fc15-4998-97fa-6e619067a672 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:33.756533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f5d4c-92de-4a23-840d-eca45d5cf642 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:33.763279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:33.763279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.763279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.763279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] PATH_INFO: `/v3/users/44a1b17b187e43a393f12227ccf296d8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.763641 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a1b17b187e43a393f12227ccf296d8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:33.765142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:33.883893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1206/2417] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:33 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:33.883893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f5d4c-92de-4a23-840d-eca45d5cf642 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:33.892684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f5d4c-92de-4a23-840d-eca45d5cf642 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:33.898078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:33.898777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:33.899064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:33.899343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] PATH_INFO: `/v3/projects/0baa46f918a5414d999936c8b39c5be5/users/98f8fab9a58d412b849f9e076d7a7fc3/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:33.921457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0baa46f918a5414d999936c8b39c5be5, user_id=98f8fab9a58d412b849f9e076d7a7fc3, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:33.924301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:33.997986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1207/2418] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:33 2022] PUT /identity/v3/projects/0baa46f918a5414d999936c8b39c5be5/users/98f8fab9a58d412b849f9e076d7a7fc3/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:33.999755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:34.001457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.017419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a1b17b187e43a393f12227ccf296d8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.233534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7f29-e39a-477d-9bae-caf3d8fb5f4a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:34.233534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:34.233534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:34.233534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:34.233910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:34.233910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:34.233910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:34.233910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1208/2419] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:34.233910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:34.233910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.234380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92040e-c377-4f5e-8d37-6da1b43d92f5 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:34.234380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:34.234380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:34.234380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:34.234693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] PATH_INFO: `/v3/users/942b97c444d24165b775b34190eac8da` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:34.234693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=942b97c444d24165b775b34190eac8da)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:34.234693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:34.468354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a1b17b187e43a393f12227ccf296d8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.472925 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a1b17b187e43a393f12227ccf296d8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.484223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a1b17b187e43a393f12227ccf296d8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.485396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a1b17b187e43a393f12227ccf296d8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.497536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1212/2420] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:33 2022] DELETE /identity/v3/users/44a1b17b187e43a393f12227ccf296d8 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:34.498350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:34.499645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.571165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f674223-ae23-4cc6-9224-fc5ee7fd58b8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:34.576642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:34.577284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:34.577563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:34.577834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:34.578486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:34.580344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:34.590852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1213/2421] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:34.592065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:34.595037 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.609128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525164b-a6b0-44dc-8fe0-559f8cbfee1c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:34.614185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:34.614837 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:34.615111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:34.615508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] PATH_INFO: `/v3/users/366fea775c414f9e92e840501fd4cf25` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:34.616764 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] RBAC: Authorizing `identity:delete_user(user_id=366fea775c414f9e92e840501fd4cf25)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:34.618702 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:34.670963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942b97c444d24165b775b34190eac8da'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.671629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942b97c444d24165b775b34190eac8da'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.765488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942b97c444d24165b775b34190eac8da'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.766035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942b97c444d24165b775b34190eac8da'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.779521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942b97c444d24165b775b34190eac8da'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.797943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1209/2422] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:34 2022] DELETE /identity/v3/users/942b97c444d24165b775b34190eac8da => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:34.797943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:34.797943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.834127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366fea775c414f9e92e840501fd4cf25'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.881890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47088d-978a-4ad7-8750-0914aaf0ed8a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:34.886946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb85f71-1f38-4115-ada7-f2eef340e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:34.887575 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb85f71-1f38-4115-ada7-f2eef340e32d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:34.887908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb85f71-1f38-4115-ada7-f2eef340e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:34.888192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb85f71-1f38-4115-ada7-f2eef340e32d admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:34.888847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb85f71-1f38-4115-ada7-f2eef340e32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:34.891056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb85f71-1f38-4115-ada7-f2eef340e32d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:34.906609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1210/2423] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:34.906609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ce73-e45c-4ca9-8ab5-42a7082002a6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:34.906609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ce73-e45c-4ca9-8ab5-42a7082002a6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:34.906609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326ce73-e45c-4ca9-8ab5-42a7082002a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:34.928685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3326ce73-e45c-4ca9-8ab5-42a7082002a6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:34.929948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3326ce73-e45c-4ca9-8ab5-42a7082002a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.938254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1211/2424] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:34.939093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ce73-e45c-4ca9-8ab5-42a7082002a6 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:34.940584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3326ce73-e45c-4ca9-8ab5-42a7082002a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.943636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366fea775c414f9e92e840501fd4cf25'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.944423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366fea775c414f9e92e840501fd4cf25'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.953333 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326ce73-e45c-4ca9-8ab5-42a7082002a6 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:34.958793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:34.958977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366fea775c414f9e92e840501fd4cf25'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.959419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:34.959861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366fea775c414f9e92e840501fd4cf25'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:34.960153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:34.960153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:34.960762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:34.962415 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:34.974138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1212/2425] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:34.974912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:34.975645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1214/2426] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:34 2022] DELETE /identity/v3/users/366fea775c414f9e92e840501fd4cf25 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:34.978414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.979861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:34.981467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:34.993382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71914ea8-1914-4440-9b98-1cb5b17bef31 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:35.054406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e1f4f-dbdf-4992-bca0-2605e68c838a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:35.059143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:35.059840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:35.060122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:35.060419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] PATH_INFO: `/v3/projects/0baa46f918a5414d999936c8b39c5be5/users/98f8fab9a58d412b849f9e076d7a7fc3/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:35.062067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:35.062345 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0baa46f918a5414d999936c8b39c5be5, user_id=98f8fab9a58d412b849f9e076d7a7fc3, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:35.062708 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:35.062994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:35.063276 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] PATH_INFO: `/v3/projects/5e0c5e9da37e4d959a0e282e5903aebf` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:35.064440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0c5e9da37e4d959a0e282e5903aebf)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:35.065020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:35.066608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:35.069733 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:35.076149 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1215/2427] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:34 2022] PUT /identity/v3/projects/0baa46f918a5414d999936c8b39c5be5/users/98f8fab9a58d412b849f9e076d7a7fc3/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:35.077085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:35.080348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:35.149085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06db2bf-71ac-4e1f-9b2b-b71930de23b5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:35.156723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:35.157413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:35.157736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:35.157946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:35.160808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:35.183169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0c5e9da37e4d959a0e282e5903aebf', 'request_id': 'req-b6b8536f-704d-4db1-a990-1f401c7b0b92'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.231047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:35.232586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:35.243526 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1216/2428] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:35.244605 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:35.246164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:35.258834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0890294-e796-41e3-8cc2-722ff852116d service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:35.274548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0c5e9da37e4d959a0e282e5903aebf', 'request_id': 'req-b6b8536f-704d-4db1-a990-1f401c7b0b92'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.278194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0c5e9da37e4d959a0e282e5903aebf', 'request_id': 'req-b6b8536f-704d-4db1-a990-1f401c7b0b92'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.291714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] The token cache is being invalidate because project 5e0c5e9da37e4d959a0e282e5903aebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:35.292153 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.293244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b6b8536f-704d-4db1-a990-1f401c7b0b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.298350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1213/2429] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:34 2022] DELETE /identity/v3/projects/5e0c5e9da37e4d959a0e282e5903aebf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:35.300992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ca61-3f3a-4e2a-8a25-a612eea50c6d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:35.301531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ca61-3f3a-4e2a-8a25-a612eea50c6d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:35.301917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7ca61-3f3a-4e2a-8a25-a612eea50c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:35.331904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a2d7ca61-3f3a-4e2a-8a25-a612eea50c6d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:35.333657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a2d7ca61-3f3a-4e2a-8a25-a612eea50c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:35.340431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:35.345660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:35.345660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:35.345660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] PATH_INFO: `/v3/projects/6058dd2384994090bf22318045cca5e0/users/0dbda21789f3435ca697068d5caa8cf9/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:35.359095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6058dd2384994090bf22318045cca5e0, user_id=0dbda21789f3435ca697068d5caa8cf9, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:35.362171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:35.401947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1214/2430] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:35.405401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119ed1-a4fd-47ad-9274-871ac029e3a7 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:35.405401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119ed1-a4fd-47ad-9274-871ac029e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:35.405401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da119ed1-a4fd-47ad-9274-871ac029e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:35.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-da119ed1-a4fd-47ad-9274-871ac029e3a7 None None] MFA Rules not processed for user `98f8fab9a58d412b849f9e076d7a7fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:35.435236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-da119ed1-a4fd-47ad-9274-871ac029e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:35.480145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1217/2431] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:35 2022] PUT /identity/v3/projects/6058dd2384994090bf22318045cca5e0/users/0dbda21789f3435ca697068d5caa8cf9/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:35.487097 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:35.493480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:35.534857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:35.543402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1215/2432] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:35.543762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119ed1-a4fd-47ad-9274-871ac029e3a7 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:35.545730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-da119ed1-a4fd-47ad-9274-871ac029e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:35.563235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da119ed1-a4fd-47ad-9274-871ac029e3a7 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:35.570712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:35.571382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:35.571667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:35.571976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] PATH_INFO: `/v3/users/bd8253352cb74781a8180e2166aa6fcc` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:35.573488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8253352cb74781a8180e2166aa6fcc)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:35.575518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:35.577975 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f047e-b74f-46a5-9bd2-b89a4d6318f6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:35.592114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:35.592827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:35.593159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:35.593378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] PATH_INFO: `/v3/projects/d2823d8f0c9c42d290867f29978aa397` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:35.594662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2823d8f0c9c42d290867f29978aa397)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:35.597232 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:35.844500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2823d8f0c9c42d290867f29978aa397', 'request_id': 'req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.845479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8253352cb74781a8180e2166aa6fcc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.846342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8253352cb74781a8180e2166aa6fcc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.943144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2823d8f0c9c42d290867f29978aa397', 'request_id': 'req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.950173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2823d8f0c9c42d290867f29978aa397', 'request_id': 'req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.960489 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] The token cache is being invalidate because project d2823d8f0c9c42d290867f29978aa397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:35.960847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.961582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:35.964035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1218/2433] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:35 2022] DELETE /identity/v3/projects/d2823d8f0c9c42d290867f29978aa397 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:35.964864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:35.966166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.022488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8253352cb74781a8180e2166aa6fcc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.023113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8253352cb74781a8180e2166aa6fcc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.028573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aded2fe-623a-4b12-b9c2-a4d6f3c29ebb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:36.032256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:36.032858 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:36.033142 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:36.033420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:36.035812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.036588 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1c65b753-8f6a-4cc3-9fe0-d249eec25faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8253352cb74781a8180e2166aa6fcc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.051206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1216/2434] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:35 2022] DELETE /identity/v3/users/bd8253352cb74781a8180e2166aa6fcc => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:36.053645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9149f-0aed-4d43-b430-0874730b47c1 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:36.053792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9149f-0aed-4d43-b430-0874730b47c1 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:36.053974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9149f-0aed-4d43-b430-0874730b47c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:36.077398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c1d9149f-0aed-4d43-b430-0874730b47c1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:36.078631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1d9149f-0aed-4d43-b430-0874730b47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.107623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:36.109099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:36.121702 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1219/2435] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:36.122393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:36.123893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.154786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1217/2436] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:36.159267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9149f-0aed-4d43-b430-0874730b47c1 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:36.159267 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1d9149f-0aed-4d43-b430-0874730b47c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.175692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9149f-0aed-4d43-b430-0874730b47c1 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:36.181572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:36.182230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:36.182367 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:36.182631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] PATH_INFO: `/v3/projects/5744981e55634330b498879fbe46280f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:36.184021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5744981e55634330b498879fbe46280f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:36.186076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:36.198061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1b44a-e341-462e-86eb-07f60a536856 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:36.250250 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:36.250866 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:36.251150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:36.251455 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:36.253906 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.325554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:36.327252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:36.339089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1220/2437] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:36.345399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:36.348875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.386540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480ca60-d0e8-43ff-bd85-77d292726abb service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:36.392852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:36.393393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:36.393733 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:36.394170 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] PATH_INFO: `/v3/users/1b13850a216747b6be3b4bd797d3088b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:36.395382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b13850a216747b6be3b4bd797d3088b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:36.397448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:36.476029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5744981e55634330b498879fbe46280f', 'request_id': 'req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.559789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5744981e55634330b498879fbe46280f', 'request_id': 'req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.567655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5744981e55634330b498879fbe46280f', 'request_id': 'req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.579869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] The token cache is being invalidate because project 5744981e55634330b498879fbe46280f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:36.579869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.579869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.584927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1218/2438] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:36 2022] DELETE /identity/v3/projects/5744981e55634330b498879fbe46280f => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:36.584927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:36.584927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.625240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b13850a216747b6be3b4bd797d3088b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.667613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3db74e-5a46-40ba-86e9-895fa3de5ef9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:36.672586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:36.673354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:36.673845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:36.674165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:36.676721 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.714296 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b13850a216747b6be3b4bd797d3088b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.715006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b13850a216747b6be3b4bd797d3088b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.733306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b13850a216747b6be3b4bd797d3088b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.733999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b13850a216747b6be3b4bd797d3088b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:36.763905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:36.765859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:36.775437 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1221/2439] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:36 2022] DELETE /identity/v3/users/1b13850a216747b6be3b4bd797d3088b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:36.776806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:36.778330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1219/2440] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:36.779202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:36.780809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.786561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:36.805783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573e132-616d-474f-99fe-3be7c7d4f755 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:36.870932 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:36.871599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:36.871893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:36.872287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] PATH_INFO: `/v3/projects/1e4f846272cb4aaca8f840d2873040c7` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:36.873604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4f846272cb4aaca8f840d2873040c7)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:36.875590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:36.905482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894767f-05f5-4bc4-9591-b5d5766fd2c2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:36.914150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:36.914849 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:36.915110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:36.915511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] PATH_INFO: `/v3/users/c43d53b23f704078bdd24b574e890a7d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:36.916792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43d53b23f704078bdd24b574e890a7d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:36.918748 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:37.008777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4f846272cb4aaca8f840d2873040c7', 'request_id': 'req-8b5a939e-2eb6-4074-87a6-e0d2363660e2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.110287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4f846272cb4aaca8f840d2873040c7', 'request_id': 'req-8b5a939e-2eb6-4074-87a6-e0d2363660e2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.120812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4f846272cb4aaca8f840d2873040c7', 'request_id': 'req-8b5a939e-2eb6-4074-87a6-e0d2363660e2'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.139155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43d53b23f704078bdd24b574e890a7d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.154183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] The token cache is being invalidate because project 1e4f846272cb4aaca8f840d2873040c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:37.154183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.157965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.172029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1220/2441] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:36 2022] DELETE /identity/v3/projects/1e4f846272cb4aaca8f840d2873040c7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:37.172029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:37.174303 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:37.228519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43d53b23f704078bdd24b574e890a7d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.229256 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43d53b23f704078bdd24b574e890a7d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.248214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43d53b23f704078bdd24b574e890a7d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.249179 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43d53b23f704078bdd24b574e890a7d'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.257672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a939e-2eb6-4074-87a6-e0d2363660e2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:37.262910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:37.264492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:37.264492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:37.264492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] PATH_INFO: `/v3/projects/ada3d8fcd577416aa83bd1d043ff3cc0` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:37.265913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada3d8fcd577416aa83bd1d043ff3cc0)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:37.266738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1222/2442] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:36 2022] DELETE /identity/v3/users/c43d53b23f704078bdd24b574e890a7d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:37.267435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:37.268280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:37.269552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:37.351629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a1103-07fb-4415-be53-60f5774d8b69 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:37.364608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:37.364608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:37.364608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:37.364608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] PATH_INFO: `/v3/projects/d17a30deba8d44dd8fcc11ae51fc5a25` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:37.365008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17a30deba8d44dd8fcc11ae51fc5a25)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:37.367445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:37.449740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada3d8fcd577416aa83bd1d043ff3cc0', 'request_id': 'req-74d60f14-c216-44f6-a410-bd7f17d308e3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.524883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada3d8fcd577416aa83bd1d043ff3cc0', 'request_id': 'req-74d60f14-c216-44f6-a410-bd7f17d308e3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.538691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada3d8fcd577416aa83bd1d043ff3cc0', 'request_id': 'req-74d60f14-c216-44f6-a410-bd7f17d308e3'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.565128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] The token cache is being invalidate because project ada3d8fcd577416aa83bd1d043ff3cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:37.567156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.569890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-74d60f14-c216-44f6-a410-bd7f17d308e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.574299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1221/2443] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:37 2022] DELETE /identity/v3/projects/ada3d8fcd577416aa83bd1d043ff3cc0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:37.577834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17a30deba8d44dd8fcc11ae51fc5a25', 'request_id': 'req-30bac1d3-b67c-4732-800b-c72c6a5bc33b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.578920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0798a71-4010-4b7f-a564-3c8bcf501344 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:37.586824 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0798a71-4010-4b7f-a564-3c8bcf501344 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:37.590414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:37.591012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0798a71-4010-4b7f-a564-3c8bcf501344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:37.618777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c0798a71-4010-4b7f-a564-3c8bcf501344 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:37.626307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c0798a71-4010-4b7f-a564-3c8bcf501344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:37.692902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1222/2444] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:37.693943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0798a71-4010-4b7f-a564-3c8bcf501344 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:37.696667 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c0798a71-4010-4b7f-a564-3c8bcf501344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:37.697147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17a30deba8d44dd8fcc11ae51fc5a25', 'request_id': 'req-30bac1d3-b67c-4732-800b-c72c6a5bc33b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.707233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17a30deba8d44dd8fcc11ae51fc5a25', 'request_id': 'req-30bac1d3-b67c-4732-800b-c72c6a5bc33b'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.713169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0798a71-4010-4b7f-a564-3c8bcf501344 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:37.718703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:37.719357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:37.719645 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:37.719964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] PATH_INFO: `/v3/users/be06160ace0b42e58422cb1cbd128357` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:37.721129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be06160ace0b42e58422cb1cbd128357)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:37.721768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] The token cache is being invalidate because project d17a30deba8d44dd8fcc11ae51fc5a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:37.722761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.723116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:37.730121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30bac1d3-b67c-4732-800b-c72c6a5bc33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.732184 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1223/2445] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:37 2022] DELETE /identity/v3/projects/d17a30deba8d44dd8fcc11ae51fc5a25 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:37.733554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3563632-2c87-4ecf-9acf-92624e290750 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:37.733851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3563632-2c87-4ecf-9acf-92624e290750 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:37.734132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3563632-2c87-4ecf-9acf-92624e290750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:37.762322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e3563632-2c87-4ecf-9acf-92624e290750 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:37.763584 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e3563632-2c87-4ecf-9acf-92624e290750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:37.772459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1224/2446] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:37.773684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96866ac-a057-4eb5-97bc-a3e4845757f3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:37.773969 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96866ac-a057-4eb5-97bc-a3e4845757f3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:37.774339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96866ac-a057-4eb5-97bc-a3e4845757f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:37.794534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c96866ac-a057-4eb5-97bc-a3e4845757f3 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:37.796078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c96866ac-a057-4eb5-97bc-a3e4845757f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:37.806938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1225/2447] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:37.807829 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96866ac-a057-4eb5-97bc-a3e4845757f3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:37.815890 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c96866ac-a057-4eb5-97bc-a3e4845757f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:37.828488 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96866ac-a057-4eb5-97bc-a3e4845757f3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:37.834335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:37.835059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:37.835407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:37.835621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] PATH_INFO: `/v3/users/75a9c3f0bbff4b8da895d237f98480ff` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:37.838926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a9c3f0bbff4b8da895d237f98480ff)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:37.838926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:37.947097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be06160ace0b42e58422cb1cbd128357'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:37.947830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be06160ace0b42e58422cb1cbd128357'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.065062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be06160ace0b42e58422cb1cbd128357'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.065970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be06160ace0b42e58422cb1cbd128357'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.086648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a9c3f0bbff4b8da895d237f98480ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.088264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be06160ace0b42e58422cb1cbd128357'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.103612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1223/2448] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:37 2022] DELETE /identity/v3/users/be06160ace0b42e58422cb1cbd128357 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:38.104640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:38.107193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.154737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:38.182743 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a9c3f0bbff4b8da895d237f98480ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.183708 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a9c3f0bbff4b8da895d237f98480ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.189130 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974058f0-16ea-436c-9aa6-6d7e135e5f13 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:38.199844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a9c3f0bbff4b8da895d237f98480ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.201314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545975d-91ec-4381-ad05-0f52adc3303f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:38.202436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545975d-91ec-4381-ad05-0f52adc3303f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.203044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545975d-91ec-4381-ad05-0f52adc3303f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.203461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545975d-91ec-4381-ad05-0f52adc3303f admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.204813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545975d-91ec-4381-ad05-0f52adc3303f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:38.205207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545975d-91ec-4381-ad05-0f52adc3303f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:38.207753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545975d-91ec-4381-ad05-0f52adc3303f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:38.208416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a9c3f0bbff4b8da895d237f98480ff'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.222936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1224/2449] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:38.224640 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda799a2-987c-4552-9a99-77bb60e95cfc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.225004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda799a2-987c-4552-9a99-77bb60e95cfc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.225353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda799a2-987c-4552-9a99-77bb60e95cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.230182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1226/2450] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:37 2022] DELETE /identity/v3/users/75a9c3f0bbff4b8da895d237f98480ff => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:38.231059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:38.232515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.250529 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fda799a2-987c-4552-9a99-77bb60e95cfc None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:38.251863 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fda799a2-987c-4552-9a99-77bb60e95cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.314090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005d819-058d-4476-9a93-5950d3e78be6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:38.322668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:38.323958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.324110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.324406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] PATH_INFO: `/v3/projects/44eb3319ca934b6fb6063c09ec206e17` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.325742 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44eb3319ca934b6fb6063c09ec206e17)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:38.328150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:38.356284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1225/2451] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:38.358400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda799a2-987c-4552-9a99-77bb60e95cfc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:38.360730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fda799a2-987c-4552-9a99-77bb60e95cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.389598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda799a2-987c-4552-9a99-77bb60e95cfc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:38.403248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d299a4-4d5f-4000-a28a-d8299903dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:38.403248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d299a4-4d5f-4000-a28a-d8299903dbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.403248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d299a4-4d5f-4000-a28a-d8299903dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.403248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d299a4-4d5f-4000-a28a-d8299903dbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.404285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d299a4-4d5f-4000-a28a-d8299903dbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:38.407518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d299a4-4d5f-4000-a28a-d8299903dbe6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:38.484979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44eb3319ca934b6fb6063c09ec206e17', 'request_id': 'req-84d7a636-f586-42c6-ac0e-2fdc21ef7603'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.542845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1226/2452] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:38 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:38.544393 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9805c-a056-47e0-aac3-542f0ca78a59 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.544689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9805c-a056-47e0-aac3-542f0ca78a59 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.544972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9805c-a056-47e0-aac3-542f0ca78a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.556607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44eb3319ca934b6fb6063c09ec206e17', 'request_id': 'req-84d7a636-f586-42c6-ac0e-2fdc21ef7603'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.582173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-83e9805c-a056-47e0-aac3-542f0ca78a59 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:38.583540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44eb3319ca934b6fb6063c09ec206e17', 'request_id': 'req-84d7a636-f586-42c6-ac0e-2fdc21ef7603'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.584361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-83e9805c-a056-47e0-aac3-542f0ca78a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.619127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] The token cache is being invalidate because project 44eb3319ca934b6fb6063c09ec206e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:38.621825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.621825 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:38.626918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1227/2453] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:38 2022] DELETE /identity/v3/projects/44eb3319ca934b6fb6063c09ec206e17 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:38.629803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:38.631878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.687055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1227/2454] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:38.687532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503312b-cb7a-4d28-909c-8f1150891cf6 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.687951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503312b-cb7a-4d28-909c-8f1150891cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.688349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503312b-cb7a-4d28-909c-8f1150891cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.736100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7a636-f586-42c6-ac0e-2fdc21ef7603 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:38.742499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:38.743190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.743700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.744006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.745070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:38.745206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2503312b-cb7a-4d28-909c-8f1150891cf6 None None] MFA Rules not processed for user `0dbda21789f3435ca697068d5caa8cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:38.745450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:38.747027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2503312b-cb7a-4d28-909c-8f1150891cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.748617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:38.771780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1228/2455] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:38.771780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:38.779050 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.799060 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d89033-d042-4219-94b6-9d6ca4585aef admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:38.808407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:38.810832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:38.811770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.812273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.812758 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.814372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:38.818888 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:38.837257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1228/2456] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:38.838790 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306ec06-cc9a-4fd6-8f89-5f1fad697561 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.839507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306ec06-cc9a-4fd6-8f89-5f1fad697561 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.840018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306ec06-cc9a-4fd6-8f89-5f1fad697561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.870180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6306ec06-cc9a-4fd6-8f89-5f1fad697561 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:38.871443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6306ec06-cc9a-4fd6-8f89-5f1fad697561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.880331 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1229/2457] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:38.881175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306ec06-cc9a-4fd6-8f89-5f1fad697561 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:38.882462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6306ec06-cc9a-4fd6-8f89-5f1fad697561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.895080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306ec06-cc9a-4fd6-8f89-5f1fad697561 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:38.901329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:38.901329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.901329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.901329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] PATH_INFO: `/v3/projects/cd55d6e028144663bc2658cda45df6b6` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:38.902924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd55d6e028144663bc2658cda45df6b6)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:38.905149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:38.923424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1229/2458] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:38 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:38.924320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:38.926597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:38.994094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c8069-e63a-4468-beb0-fb93feea8fad admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:38.998583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c4a5-79b3-4737-8cda-8d9e9acfa370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:38.999214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c4a5-79b3-4737-8cda-8d9e9acfa370 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:38.999669 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c4a5-79b3-4737-8cda-8d9e9acfa370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:38.999997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c4a5-79b3-4737-8cda-8d9e9acfa370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.012382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475c4a5-79b3-4737-8cda-8d9e9acfa370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.013876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475c4a5-79b3-4737-8cda-8d9e9acfa370 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.025688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1230/2459] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:39.026655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c4a5-79b3-4737-8cda-8d9e9acfa370 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.037326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c4a5-79b3-4737-8cda-8d9e9acfa370 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.044840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.045738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.046128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.046540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.047646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.051356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.072382 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:39.078880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd55d6e028144663bc2658cda45df6b6', 'request_id': 'req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:39.176922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd55d6e028144663bc2658cda45df6b6', 'request_id': 'req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:39.187297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd55d6e028144663bc2658cda45df6b6', 'request_id': 'req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:39.191760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1231/2460] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:39.192603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.194783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.210677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] The token cache is being invalidate because project cd55d6e028144663bc2658cda45df6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:39.218544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:39.218544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-ab8d331d-9f14-4bc9-9ae3-f094b1895b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:39.218544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1230/2461] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:38 2022] DELETE /identity/v3/projects/cd55d6e028144663bc2658cda45df6b6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:39.219606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103956-d7ab-4062-aad0-638bdd5e2adb None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.219606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103956-d7ab-4062-aad0-638bdd5e2adb None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.219606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57103956-d7ab-4062-aad0-638bdd5e2adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.250447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-57103956-d7ab-4062-aad0-638bdd5e2adb None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:39.251642 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-57103956-d7ab-4062-aad0-638bdd5e2adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.282376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c5e79-0c49-4313-8463-3026e0d3c3be admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.289553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.290956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.291407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.291868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.299779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.412163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1231/2462] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:39.412163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57103956-d7ab-4062-aad0-638bdd5e2adb None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.412163 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-57103956-d7ab-4062-aad0-638bdd5e2adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.423811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57103956-d7ab-4062-aad0-638bdd5e2adb None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.426346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.428872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.432099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266db52-1688-45a7-b9ff-d7d995c154ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.432907 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266db52-1688-45a7-b9ff-d7d995c154ff admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.433340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266db52-1688-45a7-b9ff-d7d995c154ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.433721 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266db52-1688-45a7-b9ff-d7d995c154ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.434553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266db52-1688-45a7-b9ff-d7d995c154ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.437711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266db52-1688-45a7-b9ff-d7d995c154ff admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.454133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1232/2463] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:39.454789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.458714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.464488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1232/2464] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:39.469291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd4ce-c5ce-44ee-b6e2-5911ecab63fe None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.469558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd4ce-c5ce-44ee-b6e2-5911ecab63fe None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.470920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cd4ce-c5ce-44ee-b6e2-5911ecab63fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.486537 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f37f8a-b487-4562-af02-0bbaca06d275 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.502369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18f4c5-ab9d-4ce5-a662-361346199a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.503811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18f4c5-ab9d-4ce5-a662-361346199a0e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.504178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18f4c5-ab9d-4ce5-a662-361346199a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.504522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18f4c5-ab9d-4ce5-a662-361346199a0e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.505235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18f4c5-ab9d-4ce5-a662-361346199a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.508891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18f4c5-ab9d-4ce5-a662-361346199a0e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.512954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1c6cd4ce-c5ce-44ee-b6e2-5911ecab63fe None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:39.514282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1c6cd4ce-c5ce-44ee-b6e2-5911ecab63fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.523755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1233/2465] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:39.524712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd4ce-c5ce-44ee-b6e2-5911ecab63fe None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.545856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cd4ce-c5ce-44ee-b6e2-5911ecab63fe None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.554308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.555028 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.555569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.556081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.556892 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:39.557364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.559212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.575819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1234/2466] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:39.575819 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.584851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec70f5d-f6b3-43c8-9770-daa6fa1de4a7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.590109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9482b-2fe3-48b5-87c6-7b4a020f23ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.590718 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9482b-2fe3-48b5-87c6-7b4a020f23ac admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.591025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9482b-2fe3-48b5-87c6-7b4a020f23ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.591305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9482b-2fe3-48b5-87c6-7b4a020f23ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.592182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9482b-2fe3-48b5-87c6-7b4a020f23ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.593977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9482b-2fe3-48b5-87c6-7b4a020f23ac admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.608782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1235/2467] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:39.608782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eba61-bc95-4dea-a481-1d6c39b3dee8 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.611440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eba61-bc95-4dea-a481-1d6c39b3dee8 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.616302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eba61-bc95-4dea-a481-1d6c39b3dee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.642367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1233/2468] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/users => generated 281 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:39.643773 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18f4c5-ab9d-4ce5-a662-361346199a0e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.649293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-123eba61-bc95-4dea-a481-1d6c39b3dee8 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:39.650618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-123eba61-bc95-4dea-a481-1d6c39b3dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.662109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18f4c5-ab9d-4ce5-a662-361346199a0e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.667440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.669105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1236/2469] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:39.670205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eba61-bc95-4dea-a481-1d6c39b3dee8 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.673983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.676224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.677317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.678131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.688338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eba61-bc95-4dea-a481-1d6c39b3dee8 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.691783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91249557-8996-46eb-9ed8-6b928b0214a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.692468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91249557-8996-46eb-9ed8-6b928b0214a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.692753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91249557-8996-46eb-9ed8-6b928b0214a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.693048 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91249557-8996-46eb-9ed8-6b928b0214a1 admin admin] PATH_INFO: `/v3/projects/b0d87e73840e49e8a9d6528f08092dbf/users/3667e79572a64edf9b13b4e3a5029a4a/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.693436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.710315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91249557-8996-46eb-9ed8-6b928b0214a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d87e73840e49e8a9d6528f08092dbf, user_id=3667e79572a64edf9b13b4e3a5029a4a, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.713732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91249557-8996-46eb-9ed8-6b928b0214a1 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.808036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1234/2470] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:39.808679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.810378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:39.831567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1237/2471] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:39 2022] PUT /identity/v3/projects/b0d87e73840e49e8a9d6528f08092dbf/users/3667e79572a64edf9b13b4e3a5029a4a/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:39.831567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91249557-8996-46eb-9ed8-6b928b0214a1 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.901047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289936a2-2f24-4a02-97bf-3a4cfb440dcb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.906845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91249557-8996-46eb-9ed8-6b928b0214a1 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.907036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.907942 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.908385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.908919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] PATH_INFO: `/v3/projects/580fffff66a1442eb22428bbd9ed9c9d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.911464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] RBAC: Authorizing `identity:delete_project(project_id=580fffff66a1442eb22428bbd9ed9c9d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.913632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a1af-047c-4d1e-b2ed-82edc7088dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.914147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a1af-047c-4d1e-b2ed-82edc7088dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.914500 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a1af-047c-4d1e-b2ed-82edc7088dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.914899 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612a1af-047c-4d1e-b2ed-82edc7088dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.915307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.915647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a1af-047c-4d1e-b2ed-82edc7088dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.917494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612a1af-047c-4d1e-b2ed-82edc7088dcb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.929535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1238/2472] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:39.937360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a1af-047c-4d1e-b2ed-82edc7088dcb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.948376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612a1af-047c-4d1e-b2ed-82edc7088dcb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.957619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.958251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.958550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.958809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.959495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:39.959841 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.961532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:39.975689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1239/2473] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:39.976561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:39.986908 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da68c8-2a88-4459-b103-1ac859593bfa admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:39.992613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e88951-9fbf-484c-aa5c-1d62f34a6fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:39.992931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88951-9fbf-484c-aa5c-1d62f34a6fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:39.993155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88951-9fbf-484c-aa5c-1d62f34a6fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:39.993428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88951-9fbf-484c-aa5c-1d62f34a6fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:39.994059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e88951-9fbf-484c-aa5c-1d62f34a6fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:39.997287 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e88951-9fbf-484c-aa5c-1d62f34a6fa3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.000709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:40.071594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580fffff66a1442eb22428bbd9ed9c9d', 'request_id': 'req-c786414f-cb02-4372-bbe1-bfeb3ed016db'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.097413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1240/2474] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:39 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:40.098960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd84-51ff-4cc4-b7b4-c2816705c165 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.099426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd84-51ff-4cc4-b7b4-c2816705c165 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.099710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61afd84-51ff-4cc4-b7b4-c2816705c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.135389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c61afd84-51ff-4cc4-b7b4-c2816705c165 None None] MFA Rules not processed for user `3667e79572a64edf9b13b4e3a5029a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:40.136766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c61afd84-51ff-4cc4-b7b4-c2816705c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.161128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580fffff66a1442eb22428bbd9ed9c9d', 'request_id': 'req-c786414f-cb02-4372-bbe1-bfeb3ed016db'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.168465 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580fffff66a1442eb22428bbd9ed9c9d', 'request_id': 'req-c786414f-cb02-4372-bbe1-bfeb3ed016db'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.180728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] The token cache is being invalidate because project 580fffff66a1442eb22428bbd9ed9c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:40.181264 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.185329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.185329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1235/2475] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:39 2022] DELETE /identity/v3/projects/580fffff66a1442eb22428bbd9ed9c9d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:40.185329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.188189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.231480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1241/2476] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:40.236735 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61afd84-51ff-4cc4-b7b4-c2816705c165 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.239951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c61afd84-51ff-4cc4-b7b4-c2816705c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.276360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786414f-cb02-4372-bbe1-bfeb3ed016db admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.281603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.282220 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.282499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.282772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.283454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.285217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.307940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1236/2477] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:40.307940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.307940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.325085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d1f30-552d-459e-9745-470b911fd4cc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.329384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.334374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.334374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.334374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.334374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.334374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.340707 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61afd84-51ff-4cc4-b7b4-c2816705c165 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.345769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1237/2478] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:40.347125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.349547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.350409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.350551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.350996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.351464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.353221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.357245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.369815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d3b12-0124-4c41-9329-6958ee1ed90a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.375078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.375999 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.376447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.376875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] PATH_INFO: `/v3/users/98f8fab9a58d412b849f9e076d7a7fc3` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.379369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f8fab9a58d412b849f9e076d7a7fc3)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.381434 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.464145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1242/2479] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:40 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:40.468215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.470783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.538574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12212e00-2ef7-44df-b8db-578515c17188 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.539324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324b82e-f2dd-4239-abbd-dcdbeb5b1a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.540127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324b82e-f2dd-4239-abbd-dcdbeb5b1a96 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.540243 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324b82e-f2dd-4239-abbd-dcdbeb5b1a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.540485 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324b82e-f2dd-4239-abbd-dcdbeb5b1a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.603132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324b82e-f2dd-4239-abbd-dcdbeb5b1a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.604621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324b82e-f2dd-4239-abbd-dcdbeb5b1a96 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.614363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1243/2480] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:40.615229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324b82e-f2dd-4239-abbd-dcdbeb5b1a96 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.616393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f8fab9a58d412b849f9e076d7a7fc3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.682710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324b82e-f2dd-4239-abbd-dcdbeb5b1a96 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.687584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.688276 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.688608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.688987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] PATH_INFO: `/v3/projects/47036bbd1bd04a43be56cfcb69bb3169/users/cfea24d02b06484a991669c9d467f8b6/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.707400 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47036bbd1bd04a43be56cfcb69bb3169, user_id=cfea24d02b06484a991669c9d467f8b6, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.710620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.730799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f8fab9a58d412b849f9e076d7a7fc3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.731515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f8fab9a58d412b849f9e076d7a7fc3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.751122 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f8fab9a58d412b849f9e076d7a7fc3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.752215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f8fab9a58d412b849f9e076d7a7fc3'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:40.768101 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1238/2481] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:40 2022] DELETE /identity/v3/users/98f8fab9a58d412b849f9e076d7a7fc3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:40.769737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.771940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.812043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1244/2482] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:40 2022] PUT /identity/v3/projects/47036bbd1bd04a43be56cfcb69bb3169/users/cfea24d02b06484a991669c9d467f8b6/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:40.812504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.814203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:40.865668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a784c8-554c-4b5b-9eaa-0da2ff12526b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.899562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748b2ce-df4f-4c67-9092-6b044bfb8da4 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:40.904759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.905390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.905672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.905952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.906594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.908557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.935839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:40.936783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:40.937099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:40.937415 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:40.938086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:40.939828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:40.951211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1239/2483] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:40.951973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:40.953803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.017428 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e57d47-93eb-4d3c-bd00-85940942417b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.022514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1884-3a22-42a6-aa1b-d35d0252c0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.023441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1884-3a22-42a6-aa1b-d35d0252c0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.023739 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1884-3a22-42a6-aa1b-d35d0252c0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.024032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1884-3a22-42a6-aa1b-d35d0252c0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.026621 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-63cd1884-3a22-42a6-aa1b-d35d0252c0d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.087398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1245/2484] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:40 2022] POST /identity/v3/users => generated 284 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:41.087398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.090362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.102030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1884-3a22-42a6-aa1b-d35d0252c0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.104100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd1884-3a22-42a6-aa1b-d35d0252c0d1 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.117195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1240/2485] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:41.117476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785638dd-ce3e-43c3-97a5-643049a51a0b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.125884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287369-3abd-471d-b6c3-134d85fa6459 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.126182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287369-3abd-471d-b6c3-134d85fa6459 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.126480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287369-3abd-471d-b6c3-134d85fa6459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.134297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.134996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.135560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.135873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] PATH_INFO: `/v3/users/3667e79572a64edf9b13b4e3a5029a4a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.137539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3667e79572a64edf9b13b4e3a5029a4a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.140611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.147289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:41.192583 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-84287369-3abd-471d-b6c3-134d85fa6459 None None] MFA Rules not processed for user `cfea24d02b06484a991669c9d467f8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:41.194577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-84287369-3abd-471d-b6c3-134d85fa6459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.291972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1241/2486] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:41.294671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84287369-3abd-471d-b6c3-134d85fa6459 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.317091 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84287369-3abd-471d-b6c3-134d85fa6459 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.322354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece9a37-ccca-4e03-ad00-8d5f1d41422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.323203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9a37-ccca-4e03-ad00-8d5f1d41422b admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.323339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9a37-ccca-4e03-ad00-8d5f1d41422b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.323634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9a37-ccca-4e03-ad00-8d5f1d41422b admin admin] PATH_INFO: `/v3/projects/5bdafcb3887f46ae9c259ea4b1b0864f/users/2b1d4f266a6f446e81296e09814ea802/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.341863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece9a37-ccca-4e03-ad00-8d5f1d41422b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdafcb3887f46ae9c259ea4b1b0864f, user_id=2b1d4f266a6f446e81296e09814ea802, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.344741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece9a37-ccca-4e03-ad00-8d5f1d41422b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.409859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1242/2487] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:41 2022] PUT /identity/v3/projects/5bdafcb3887f46ae9c259ea4b1b0864f/users/2b1d4f266a6f446e81296e09814ea802/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:41.412652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece9a37-ccca-4e03-ad00-8d5f1d41422b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.415585 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3667e79572a64edf9b13b4e3a5029a4a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.416422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3667e79572a64edf9b13b4e3a5029a4a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.493949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece9a37-ccca-4e03-ad00-8d5f1d41422b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.498046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3667e79572a64edf9b13b4e3a5029a4a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.499132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3667e79572a64edf9b13b4e3a5029a4a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.500502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.503470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.503470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.503470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.503470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.505152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.515024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-3ce2e6da-206d-42d9-a4ef-37f069539e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3667e79572a64edf9b13b4e3a5029a4a'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.519302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1243/2488] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:41.520667 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.522451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.542875 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1246/2489] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:41 2022] DELETE /identity/v3/users/3667e79572a64edf9b13b4e3a5029a4a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:41.542875 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17f6e-d91b-45dd-ac03-b06ef7c7d77b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.542875 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17f6e-d91b-45dd-ac03-b06ef7c7d77b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.543561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9592b-5324-4dfe-96af-8c30a5ee9c23 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.543719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17f6e-d91b-45dd-ac03-b06ef7c7d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.577811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c1f17f6e-d91b-45dd-ac03-b06ef7c7d77b None None] MFA Rules not processed for user `2b1d4f266a6f446e81296e09814ea802`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:41.579286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1f17f6e-d91b-45dd-ac03-b06ef7c7d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.611522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.613065 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.613339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.613611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] PATH_INFO: `/v3/projects/0baa46f918a5414d999936c8b39c5be5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.614813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0baa46f918a5414d999936c8b39c5be5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.616798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.656967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1247/2490] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:41.658100 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17f6e-d91b-45dd-ac03-b06ef7c7d77b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.659547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1f17f6e-d91b-45dd-ac03-b06ef7c7d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.663147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:41.683872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17f6e-d91b-45dd-ac03-b06ef7c7d77b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.695101 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd81704-4958-48ea-91c9-1004cc8cb497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.695915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81704-4958-48ea-91c9-1004cc8cb497 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.696201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81704-4958-48ea-91c9-1004cc8cb497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.701414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd81704-4958-48ea-91c9-1004cc8cb497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.701414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd81704-4958-48ea-91c9-1004cc8cb497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.701414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd81704-4958-48ea-91c9-1004cc8cb497 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.710788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1248/2491] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:41.711973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3a46-52f4-4415-aad2-67821779e554 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.712268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3a46-52f4-4415-aad2-67821779e554 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.712541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3a46-52f4-4415-aad2-67821779e554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.746451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b58e3a46-52f4-4415-aad2-67821779e554 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:41.748002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b58e3a46-52f4-4415-aad2-67821779e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.759214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1249/2492] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:41.761926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e3a46-52f4-4415-aad2-67821779e554 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.761926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b58e3a46-52f4-4415-aad2-67821779e554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.775496 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0baa46f918a5414d999936c8b39c5be5', 'request_id': 'req-181aeab3-5033-402b-86d0-a9ad2a217298'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.788383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e3a46-52f4-4415-aad2-67821779e554 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.862071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0baa46f918a5414d999936c8b39c5be5', 'request_id': 'req-181aeab3-5033-402b-86d0-a9ad2a217298'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.870754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0baa46f918a5414d999936c8b39c5be5', 'request_id': 'req-181aeab3-5033-402b-86d0-a9ad2a217298'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.870942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d14e36-283b-43ea-9139-a8ce75401b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.872068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d14e36-283b-43ea-9139-a8ce75401b49 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.872460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d14e36-283b-43ea-9139-a8ce75401b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.872771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d14e36-283b-43ea-9139-a8ce75401b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.873516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d14e36-283b-43ea-9139-a8ce75401b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.875483 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d14e36-283b-43ea-9139-a8ce75401b49 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.883757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] The token cache is being invalidate because project 0baa46f918a5414d999936c8b39c5be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:41.884052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.886313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:41.886701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1244/2493] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:41 2022] DELETE /identity/v3/projects/0baa46f918a5414d999936c8b39c5be5 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:41.888178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:41.889114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.903427 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181aeab3-5033-402b-86d0-a9ad2a217298 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:41.908619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:41.909887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.910283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.910570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] PATH_INFO: `/v3/projects/fb1e711181a14ab6a186e91624db6516/users/33f6c55bd9004139a0e907714a7e5315/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.931413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1e711181a14ab6a186e91624db6516, user_id=33f6c55bd9004139a0e907714a7e5315, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:41.931413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:41.976698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1250/2494] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:41 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:41.976698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af276-a651-4638-8b5f-87c5ff5370f2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:41.976698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af276-a651-4638-8b5f-87c5ff5370f2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:41.976698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af276-a651-4638-8b5f-87c5ff5370f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:41.995630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-642af276-a651-4638-8b5f-87c5ff5370f2 None None] MFA Rules not processed for user `0dbda21789f3435ca697068d5caa8cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:41.996893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-642af276-a651-4638-8b5f-87c5ff5370f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:41.997110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1245/2495] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:41 2022] PUT /identity/v3/projects/fb1e711181a14ab6a186e91624db6516/users/33f6c55bd9004139a0e907714a7e5315/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:41.998965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.006337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.074093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1251/2496] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:42.074319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b98f5a-4ad2-46e1-9813-636093192c53 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.074417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af276-a651-4638-8b5f-87c5ff5370f2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.074417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-642af276-a651-4638-8b5f-87c5ff5370f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.079036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643b80a-44a9-411b-bd96-70a822e5b79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.081631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b80a-44a9-411b-bd96-70a822e5b79f service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.081631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b80a-44a9-411b-bd96-70a822e5b79f service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.081631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643b80a-44a9-411b-bd96-70a822e5b79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.084007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c643b80a-44a9-411b-bd96-70a822e5b79f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.099984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:42.168728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af276-a651-4638-8b5f-87c5ff5370f2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.172613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0bfda-a332-4c98-b500-be95b1155198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.173375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0bfda-a332-4c98-b500-be95b1155198 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.173668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0bfda-a332-4c98-b500-be95b1155198 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.173947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0bfda-a332-4c98-b500-be95b1155198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.176663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8ed0bfda-a332-4c98-b500-be95b1155198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.194760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643b80a-44a9-411b-bd96-70a822e5b79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.196514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643b80a-44a9-411b-bd96-70a822e5b79f service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.216176 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1246/2497] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:42.217781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1888f1-9b05-4b30-84fd-6b18238d3bbf None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.218145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1888f1-9b05-4b30-84fd-6b18238d3bbf None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.218614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1888f1-9b05-4b30-84fd-6b18238d3bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.241833 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-af1888f1-9b05-4b30-84fd-6b18238d3bbf None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:42.243317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-af1888f1-9b05-4b30-84fd-6b18238d3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.251490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1247/2498] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:42.253513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1888f1-9b05-4b30-84fd-6b18238d3bbf None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.254563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-af1888f1-9b05-4b30-84fd-6b18238d3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.262886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0bfda-a332-4c98-b500-be95b1155198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.267469 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0bfda-a332-4c98-b500-be95b1155198 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.268510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1888f1-9b05-4b30-84fd-6b18238d3bbf None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.278894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d573c-c2c0-4304-99c2-a607927164e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.282195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d573c-c2c0-4304-99c2-a607927164e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.282195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d573c-c2c0-4304-99c2-a607927164e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.282195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d573c-c2c0-4304-99c2-a607927164e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.282195 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d573c-c2c0-4304-99c2-a607927164e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.282634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1252/2499] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:42.283025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835edf-f118-45c9-a22c-709b7eaffd62 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.283318 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835edf-f118-45c9-a22c-709b7eaffd62 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.283639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a835edf-f118-45c9-a22c-709b7eaffd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.289515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d573c-c2c0-4304-99c2-a607927164e6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.398520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1248/2500] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/users => generated 297 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:42.399874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb3ab5-51fd-448b-939b-5a7f2d0a05d2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.400199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb3ab5-51fd-448b-939b-5a7f2d0a05d2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.400895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb3ab5-51fd-448b-939b-5a7f2d0a05d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.432870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-caeb3ab5-51fd-448b-939b-5a7f2d0a05d2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:42.434461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-caeb3ab5-51fd-448b-939b-5a7f2d0a05d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.444958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1249/2501] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:42.445965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb3ab5-51fd-448b-939b-5a7f2d0a05d2 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.447897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-caeb3ab5-51fd-448b-939b-5a7f2d0a05d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.457266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-0a835edf-f118-45c9-a22c-709b7eaffd62 None None] MFA Rules not processed for user `33f6c55bd9004139a0e907714a7e5315`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:42.459184 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-0a835edf-f118-45c9-a22c-709b7eaffd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.465801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb3ab5-51fd-448b-939b-5a7f2d0a05d2 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.472456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.473112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.473403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.473685 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] PATH_INFO: `/v3/users/cfea24d02b06484a991669c9d467f8b6` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.474873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfea24d02b06484a991669c9d467f8b6)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.477226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.531495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1253/2502] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:42.532764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a835edf-f118-45c9-a22c-709b7eaffd62 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.543412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a835edf-f118-45c9-a22c-709b7eaffd62 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.548349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1b4e1-e487-493a-95fa-770a8cdc43b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.548958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b4e1-e487-493a-95fa-770a8cdc43b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.549272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b4e1-e487-493a-95fa-770a8cdc43b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.549489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1b4e1-e487-493a-95fa-770a8cdc43b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.550946 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1b4e1-e487-493a-95fa-770a8cdc43b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.552594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1b4e1-e487-493a-95fa-770a8cdc43b7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.564564 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1254/2503] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:42.565987 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1b4e1-e487-493a-95fa-770a8cdc43b7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.576115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1b4e1-e487-493a-95fa-770a8cdc43b7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.581347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f23b2e-d556-4449-882b-70092c633fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.582289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23b2e-d556-4449-882b-70092c633fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.582673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23b2e-d556-4449-882b-70092c633fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.583167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23b2e-d556-4449-882b-70092c633fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.584014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f23b2e-d556-4449-882b-70092c633fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:42.584360 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f23b2e-d556-4449-882b-70092c633fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.586003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f23b2e-d556-4449-882b-70092c633fd5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.599571 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1255/2504] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:42.604573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6bb83-b516-4895-a334-5e8e164ad29c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.604831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6bb83-b516-4895-a334-5e8e164ad29c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.605135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6bb83-b516-4895-a334-5e8e164ad29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-b0f6bb83-b516-4895-a334-5e8e164ad29c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:19:42.611573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:42.613427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:19:42.614845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1256/2505] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:19:42.614971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6bb83-b516-4895-a334-5e8e164ad29c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.638736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6bb83-b516-4895-a334-5e8e164ad29c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.643714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb482ac-3dfe-42c6-a3b6-185de76ab4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.644874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb482ac-3dfe-42c6-a3b6-185de76ab4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.645167 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb482ac-3dfe-42c6-a3b6-185de76ab4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.645443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb482ac-3dfe-42c6-a3b6-185de76ab4e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.646077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb482ac-3dfe-42c6-a3b6-185de76ab4e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.648000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb482ac-3dfe-42c6-a3b6-185de76ab4e3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.693341 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfea24d02b06484a991669c9d467f8b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.763761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1257/2506] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:42.764352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb482ac-3dfe-42c6-a3b6-185de76ab4e3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.805903 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfea24d02b06484a991669c9d467f8b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.806787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfea24d02b06484a991669c9d467f8b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.833808 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfea24d02b06484a991669c9d467f8b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.834998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfea24d02b06484a991669c9d467f8b6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:42.842742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb482ac-3dfe-42c6-a3b6-185de76ab4e3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.856856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.856856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.856856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.856856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] PATH_INFO: `/v3/projects/eb2358688ae9481a8343263f508df364/users/fcddadf64e8f471ab7446fa612d4f648/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.861932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1250/2507] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:42 2022] DELETE /identity/v3/users/cfea24d02b06484a991669c9d467f8b6 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:42.865226 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.868152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:42.871660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2358688ae9481a8343263f508df364, user_id=fcddadf64e8f471ab7446fa612d4f648, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.875089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.943317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58e64b-19fc-4aa1-9b8c-02a12701ea74 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:42.948376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:42.948933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:42.949252 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:42.949502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:42.950151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:42.952119 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:42.965874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1258/2508] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:42 2022] PUT /identity/v3/projects/eb2358688ae9481a8343263f508df364/users/fcddadf64e8f471ab7446fa612d4f648/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:42.966706 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:42.969069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.055243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1251/2509] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/projects => generated 389 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:43.057975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21409248-4376-49c9-8a0d-2f9179326004 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.059348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.063223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.146543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2a2f7-6d60-4b57-bab3-548e920d8d54 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.148143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bd7bf-3ffb-49fe-90e9-86d17f5d4372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.148774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd7bf-3ffb-49fe-90e9-86d17f5d4372 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.149061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd7bf-3ffb-49fe-90e9-86d17f5d4372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.149339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bd7bf-3ffb-49fe-90e9-86d17f5d4372 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.149977 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bd7bf-3ffb-49fe-90e9-86d17f5d4372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.151948 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bd7bf-3ffb-49fe-90e9-86d17f5d4372 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.152406 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.153169 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.153561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.153856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] PATH_INFO: `/v3/projects/b0d87e73840e49e8a9d6528f08092dbf` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.155076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d87e73840e49e8a9d6528f08092dbf)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.157030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.274871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1259/2510] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:42 2022] POST /identity/v3/users => generated 290 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:43.276041 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca74e2-43fe-4a9f-9979-a4d46308faac None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.276322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca74e2-43fe-4a9f-9979-a4d46308faac None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.276552 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca74e2-43fe-4a9f-9979-a4d46308faac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.302261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-21ca74e2-43fe-4a9f-9979-a4d46308faac None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:43.304230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-21ca74e2-43fe-4a9f-9979-a4d46308faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.321013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1260/2511] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:43.322170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca74e2-43fe-4a9f-9979-a4d46308faac None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.323534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-21ca74e2-43fe-4a9f-9979-a4d46308faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.336366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca74e2-43fe-4a9f-9979-a4d46308faac None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.351904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d87e73840e49e8a9d6528f08092dbf', 'request_id': 'req-cb9b653a-ec24-43a0-850c-6902c5feb974'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:43.403312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b38cda-78a9-47d8-87ae-0d6f85cf8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.403997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b38cda-78a9-47d8-87ae-0d6f85cf8499 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.404278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b38cda-78a9-47d8-87ae-0d6f85cf8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.404553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b38cda-78a9-47d8-87ae-0d6f85cf8499 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.405192 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b38cda-78a9-47d8-87ae-0d6f85cf8499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.406768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b38cda-78a9-47d8-87ae-0d6f85cf8499 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.416798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1261/2512] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:43.417566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b38cda-78a9-47d8-87ae-0d6f85cf8499 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.428025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b38cda-78a9-47d8-87ae-0d6f85cf8499 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.432955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.433488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.433772 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.434047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.434681 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.436666 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.451780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d87e73840e49e8a9d6528f08092dbf', 'request_id': 'req-cb9b653a-ec24-43a0-850c-6902c5feb974'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:43.462112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d87e73840e49e8a9d6528f08092dbf', 'request_id': 'req-cb9b653a-ec24-43a0-850c-6902c5feb974'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:43.474235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] The token cache is being invalidate because project b0d87e73840e49e8a9d6528f08092dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:43.474527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:43.475209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:43.476781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1252/2513] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:43 2022] DELETE /identity/v3/projects/b0d87e73840e49e8a9d6528f08092dbf => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:43.477855 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.479196 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.493519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b653a-ec24-43a0-850c-6902c5feb974 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.499014 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.499611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.499899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.500182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.500838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.502446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.515254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1253/2514] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:43.515428 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.517202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.528805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1262/2515] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:43 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:43.530032 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.535942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.553891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b065e-e9e7-4738-83f2-bcc0bee94572 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.559054 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390d396-3de3-40d5-9791-4d54908da538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.559922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d396-3de3-40d5-9791-4d54908da538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.560235 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d396-3de3-40d5-9791-4d54908da538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.560546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390d396-3de3-40d5-9791-4d54908da538 admin admin] PATH_INFO: `/v3/projects/eb2358688ae9481a8343263f508df364/users/fcddadf64e8f471ab7446fa612d4f648/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.562782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390d396-3de3-40d5-9791-4d54908da538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2358688ae9481a8343263f508df364, user_id=fcddadf64e8f471ab7446fa612d4f648, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.565686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390d396-3de3-40d5-9791-4d54908da538 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.579653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1263/2516] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:43 2022] PUT /identity/v3/projects/eb2358688ae9481a8343263f508df364/users/fcddadf64e8f471ab7446fa612d4f648/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:43.590502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee63d2e-8a68-4244-ab5e-d201ea900605 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.590502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee63d2e-8a68-4244-ab5e-d201ea900605 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.590502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee63d2e-8a68-4244-ab5e-d201ea900605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.601478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d617ca-2679-4360-b14c-a7b0d69ff487 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.605546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-aee63d2e-8a68-4244-ab5e-d201ea900605 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:43.606779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aee63d2e-8a68-4244-ab5e-d201ea900605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.663879 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.664502 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.664779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.665052 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.666792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.677284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1264/2517] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:43.678240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee63d2e-8a68-4244-ab5e-d201ea900605 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.688326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee63d2e-8a68-4244-ab5e-d201ea900605 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.693865 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d922d09-306c-4c0d-8a52-8b25d31c9184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.694920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922d09-306c-4c0d-8a52-8b25d31c9184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.695459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922d09-306c-4c0d-8a52-8b25d31c9184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.695661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d922d09-306c-4c0d-8a52-8b25d31c9184 admin admin] PATH_INFO: `/v3/projects/e4968554bf8b46eb9c905bc01e777a6d/users/813cc72e35ad4949a500e48aa9a2ff6e/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.715697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922d09-306c-4c0d-8a52-8b25d31c9184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4968554bf8b46eb9c905bc01e777a6d, user_id=813cc72e35ad4949a500e48aa9a2ff6e, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.718424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d922d09-306c-4c0d-8a52-8b25d31c9184 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.742358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.744809 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.757320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1254/2518] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:43.758292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.759700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.776433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e983c1-9095-4cc6-88db-73b2b13dde56 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.787493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1265/2519] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:43 2022] PUT /identity/v3/projects/e4968554bf8b46eb9c905bc01e777a6d/users/813cc72e35ad4949a500e48aa9a2ff6e/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:43.789351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5537a5e-2075-4416-b265-8991827e9a1f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.789592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5537a5e-2075-4416-b265-8991827e9a1f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.789860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5537a5e-2075-4416-b265-8991827e9a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.829895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-a5537a5e-2075-4416-b265-8991827e9a1f None None] MFA Rules not processed for user `fcddadf64e8f471ab7446fa612d4f648`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:43.832087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-a5537a5e-2075-4416-b265-8991827e9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.856081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ca4ae-77c3-49d4-874f-1b82f5fb7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.856384 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca4ae-77c3-49d4-874f-1b82f5fb7525 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.856534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca4ae-77c3-49d4-874f-1b82f5fb7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.856811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ca4ae-77c3-49d4-874f-1b82f5fb7525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.857628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ca4ae-77c3-49d4-874f-1b82f5fb7525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.859984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ca4ae-77c3-49d4-874f-1b82f5fb7525 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.884471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1255/2520] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:43.884471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fdb47-88c7-4c4e-9024-e8f3a8446afc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.884471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fdb47-88c7-4c4e-9024-e8f3a8446afc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.884471 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fdb47-88c7-4c4e-9024-e8f3a8446afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.912182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1266/2521] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:43.912746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5537a5e-2075-4416-b265-8991827e9a1f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.927246 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4c8fdb47-88c7-4c4e-9024-e8f3a8446afc None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:43.929509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4c8fdb47-88c7-4c4e-9024-e8f3a8446afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.933912 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5537a5e-2075-4416-b265-8991827e9a1f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.937800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.938427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.938709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.939285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.939628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.941882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.945424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1256/2522] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:43.946968 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fdb47-88c7-4c4e-9024-e8f3a8446afc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.954668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:43.955981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1267/2523] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:43.957706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fdb47-88c7-4c4e-9024-e8f3a8446afc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:43.957963 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.966472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:43.966627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c472-c20d-4900-9026-eeb8ac8b9b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:43.966627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c472-c20d-4900-9026-eeb8ac8b9b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:43.966627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c472-c20d-4900-9026-eeb8ac8b9b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:43.966627 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5c472-c20d-4900-9026-eeb8ac8b9b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:43.966995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5c472-c20d-4900-9026-eeb8ac8b9b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:43.966995 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5c472-c20d-4900-9026-eeb8ac8b9b85 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:43.979455 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1257/2524] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:43.980631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c472-c20d-4900-9026-eeb8ac8b9b85 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:43.995141 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5c472-c20d-4900-9026-eeb8ac8b9b85 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.000254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.000904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.006786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.006786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.006786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:44.006786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.006786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.018070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1258/2525] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:44.019369 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.026711 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41351eb8-8677-4917-a6d7-35a994fa17ae admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.032078 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987e85e-cd1a-488f-b3ca-3a42e315cc91 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.032649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf96187-3578-40d3-a69b-2aa7e5d296d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.033443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96187-3578-40d3-a69b-2aa7e5d296d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.033856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96187-3578-40d3-a69b-2aa7e5d296d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.034279 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf96187-3578-40d3-a69b-2aa7e5d296d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.037215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461132e-23b0-4b7a-a049-d0e7fcbb7d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.043431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461132e-23b0-4b7a-a049-d0e7fcbb7d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.043431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461132e-23b0-4b7a-a049-d0e7fcbb7d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.043431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461132e-23b0-4b7a-a049-d0e7fcbb7d98 admin admin] PATH_INFO: `/v3/projects/e4968554bf8b46eb9c905bc01e777a6d/users/813cc72e35ad4949a500e48aa9a2ff6e/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.043431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461132e-23b0-4b7a-a049-d0e7fcbb7d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4968554bf8b46eb9c905bc01e777a6d, user_id=813cc72e35ad4949a500e48aa9a2ff6e, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.043974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8461132e-23b0-4b7a-a049-d0e7fcbb7d98 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.047336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf96187-3578-40d3-a69b-2aa7e5d296d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.049354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf96187-3578-40d3-a69b-2aa7e5d296d5 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.057812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1259/2526] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:44 2022] PUT /identity/v3/projects/e4968554bf8b46eb9c905bc01e777a6d/users/813cc72e35ad4949a500e48aa9a2ff6e/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:44.060721 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461132e-23b0-4b7a-a049-d0e7fcbb7d98 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.060986 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1268/2527] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:44.066562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf96187-3578-40d3-a69b-2aa7e5d296d5 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.075035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf96187-3578-40d3-a69b-2aa7e5d296d5 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.151826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b1e66-d1bc-4f78-91f4-5abb34b2d72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.152218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461132e-23b0-4b7a-a049-d0e7fcbb7d98 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.158105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b1e66-d1bc-4f78-91f4-5abb34b2d72f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.158105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b1e66-d1bc-4f78-91f4-5abb34b2d72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.158105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b1e66-d1bc-4f78-91f4-5abb34b2d72f admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.158105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b1e66-d1bc-4f78-91f4-5abb34b2d72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.158105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b1e66-d1bc-4f78-91f4-5abb34b2d72f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.158661 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b4af8-7417-4f73-b43d-c606cad84e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.159534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4af8-7417-4f73-b43d-c606cad84e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.160540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4af8-7417-4f73-b43d-c606cad84e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.160858 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b4af8-7417-4f73-b43d-c606cad84e32 admin admin] PATH_INFO: `/v3/projects/025380b96f704c8c83345078150d25cb/users/17f0ebe41e9b4ea8bfa8ebd07eb27539/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.185311 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b4af8-7417-4f73-b43d-c606cad84e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025380b96f704c8c83345078150d25cb, user_id=17f0ebe41e9b4ea8bfa8ebd07eb27539, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.186518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b4af8-7417-4f73-b43d-c606cad84e32 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.293855 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1269/2528] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:44 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:44.294954 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d994f-e793-4bba-bf94-091bdc108ddd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.295286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d994f-e793-4bba-bf94-091bdc108ddd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.295569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d994f-e793-4bba-bf94-091bdc108ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.297260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1260/2529] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:44 2022] PUT /identity/v3/projects/025380b96f704c8c83345078150d25cb/users/17f0ebe41e9b4ea8bfa8ebd07eb27539/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:44.312185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b4af8-7417-4f73-b43d-c606cad84e32 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.345817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c53d994f-e793-4bba-bf94-091bdc108ddd None None] MFA Rules not processed for user `813cc72e35ad4949a500e48aa9a2ff6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:44.347879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c53d994f-e793-4bba-bf94-091bdc108ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:44.448301 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b4af8-7417-4f73-b43d-c606cad84e32 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.452233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1270/2530] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:44.456739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe1db-fcdd-4657-a6ae-70f2746b70f2 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.456739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe1db-fcdd-4657-a6ae-70f2746b70f2 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.456739 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fe1db-fcdd-4657-a6ae-70f2746b70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.487478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:44.511345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7a0fe1db-fcdd-4657-a6ae-70f2746b70f2 None None] MFA Rules not processed for user `17f0ebe41e9b4ea8bfa8ebd07eb27539`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:44.512668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7a0fe1db-fcdd-4657-a6ae-70f2746b70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:44.542819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471ef1e-6397-4e8c-8d0d-66709789bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.543453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471ef1e-6397-4e8c-8d0d-66709789bf5c admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.543751 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471ef1e-6397-4e8c-8d0d-66709789bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.544046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471ef1e-6397-4e8c-8d0d-66709789bf5c admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.544684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471ef1e-6397-4e8c-8d0d-66709789bf5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.546709 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471ef1e-6397-4e8c-8d0d-66709789bf5c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.579491 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1271/2531] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:44.580597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe1db-fcdd-4657-a6ae-70f2746b70f2 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.582828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7a0fe1db-fcdd-4657-a6ae-70f2746b70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:44.597204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fe1db-fcdd-4657-a6ae-70f2746b70f2 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.601944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.602909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.603244 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.603526 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] PATH_INFO: `/v3/projects/47036bbd1bd04a43be56cfcb69bb3169` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.604792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=47036bbd1bd04a43be56cfcb69bb3169)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.606639 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.649073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1261/2532] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:44 2022] POST /identity/v3/users => generated 292 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:44.650377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471ef1e-6397-4e8c-8d0d-66709789bf5c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.713453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47036bbd1bd04a43be56cfcb69bb3169', 'request_id': 'req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:44.719299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471ef1e-6397-4e8c-8d0d-66709789bf5c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.767424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.767980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.768261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.769593 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.808203 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47036bbd1bd04a43be56cfcb69bb3169', 'request_id': 'req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:44.809344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47036bbd1bd04a43be56cfcb69bb3169', 'request_id': 'req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:44.827614 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] The token cache is being invalidate because project 47036bbd1bd04a43be56cfcb69bb3169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:44.832628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:44.832628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:44.832628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1272/2533] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:44 2022] DELETE /identity/v3/projects/47036bbd1bd04a43be56cfcb69bb3169 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:44.832628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.832628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:44.843822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.845478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.856710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1262/2534] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:44.857940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.859026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:44.871228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c25df-001a-492a-b282-e63f9cc5713f service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.875075 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.875780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.876082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.876337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.879780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:44.905560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a709e-0f25-4bf0-ba0a-e21f3d0874dc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.910983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8019ec0-4cb9-4616-9f9f-c0ccaa6f0c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.911608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8019ec0-4cb9-4616-9f9f-c0ccaa6f0c26 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.912346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8019ec0-4cb9-4616-9f9f-c0ccaa6f0c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.912572 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8019ec0-4cb9-4616-9f9f-c0ccaa6f0c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.913220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8019ec0-4cb9-4616-9f9f-c0ccaa6f0c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.914807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8019ec0-4cb9-4616-9f9f-c0ccaa6f0c26 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.926234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1273/2535] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:44.929111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4147b-08b2-4a41-a319-6e523916b5c4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.929472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4147b-08b2-4a41-a319-6e523916b5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.929742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4147b-08b2-4a41-a319-6e523916b5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.947919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.949620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.949934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-00f4147b-08b2-4a41-a319-6e523916b5c4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:44.951205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-00f4147b-08b2-4a41-a319-6e523916b5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:44.964029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1263/2536] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:44.964198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1274/2537] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:44.964295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:44.967224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5e5da-ab6f-4c61-b2e4-dcbd4c8b715e None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.967508 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5e5da-ab6f-4c61-b2e4-dcbd4c8b715e None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.967830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c5e5da-ab6f-4c61-b2e4-dcbd4c8b715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.974736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0d8e6-9305-46e4-a4ad-ec01554998cc service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:44.981589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509795a-487f-45bf-ae9a-8e928debb6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:44.982285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509795a-487f-45bf-ae9a-8e928debb6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:44.982636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509795a-487f-45bf-ae9a-8e928debb6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:44.983025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509795a-487f-45bf-ae9a-8e928debb6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:44.983986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509795a-487f-45bf-ae9a-8e928debb6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:44.985918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509795a-487f-45bf-ae9a-8e928debb6dc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:44.992242 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-41c5e5da-ab6f-4c61-b2e4-dcbd4c8b715e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:44.998595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-41c5e5da-ab6f-4c61-b2e4-dcbd4c8b715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:44.999283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1264/2538] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:45.004405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509795a-487f-45bf-ae9a-8e928debb6dc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.007250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1275/2539] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:45.008171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5e5da-ab6f-4c61-b2e4-dcbd4c8b715e None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.017185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509795a-487f-45bf-ae9a-8e928debb6dc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.031307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c5e5da-ab6f-4c61-b2e4-dcbd4c8b715e None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.031574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.031574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.031574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.031574 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] PATH_INFO: `/v3/projects/5db737d9186741468e9677a66d75743d/users/70022dac5bba48c1b71ad23d269003c9/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.032379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.032379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.032379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.032379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.033142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:45.033142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.033971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.043230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db737d9186741468e9677a66d75743d, user_id=70022dac5bba48c1b71ad23d269003c9, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.046591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.053808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1276/2540] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:45.054783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.068268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9bb31d-c013-49f5-a766-a2018441aae9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.073313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae6923-3ae3-4c57-8f26-0c5e1871edd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.074072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae6923-3ae3-4c57-8f26-0c5e1871edd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.074628 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae6923-3ae3-4c57-8f26-0c5e1871edd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.075089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae6923-3ae3-4c57-8f26-0c5e1871edd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.080249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae6923-3ae3-4c57-8f26-0c5e1871edd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.083401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae6923-3ae3-4c57-8f26-0c5e1871edd4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.132302 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1265/2541] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:45 2022] PUT /identity/v3/projects/5db737d9186741468e9677a66d75743d/users/70022dac5bba48c1b71ad23d269003c9/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:45.141564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.143441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:45.201834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218374c-bfab-43f4-8e98-c98852c19c9e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.205688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.206360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.206643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.206918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.208779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:45.235820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1277/2542] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:45 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:45.238060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900f28-1318-4bc1-ae7b-48972621ae74 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.238728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900f28-1318-4bc1-ae7b-48972621ae74 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.238728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21900f28-1318-4bc1-ae7b-48972621ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.268131 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-21900f28-1318-4bc1-ae7b-48972621ae74 None None] MFA Rules not processed for user `70022dac5bba48c1b71ad23d269003c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:45.269922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-21900f28-1318-4bc1-ae7b-48972621ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:45.276211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.277646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.287493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1266/2543] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:45.288129 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.352234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1278/2544] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:45.356965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21900f28-1318-4bc1-ae7b-48972621ae74 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.366012 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb6f4-54e5-475d-ab92-18bbd440b1d4 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.442245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21900f28-1318-4bc1-ae7b-48972621ae74 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.446893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816dc11-a352-40a1-80e1-38419ae7f80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.447517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816dc11-a352-40a1-80e1-38419ae7f80a admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.447837 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816dc11-a352-40a1-80e1-38419ae7f80a admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.448110 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816dc11-a352-40a1-80e1-38419ae7f80a admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.448747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816dc11-a352-40a1-80e1-38419ae7f80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.450726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816dc11-a352-40a1-80e1-38419ae7f80a admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.452899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32f1ae-56ba-4a2f-8c90-4a385013bfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.453781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32f1ae-56ba-4a2f-8c90-4a385013bfeb admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.454199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32f1ae-56ba-4a2f-8c90-4a385013bfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.454603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32f1ae-56ba-4a2f-8c90-4a385013bfeb admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.455543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32f1ae-56ba-4a2f-8c90-4a385013bfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.459303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32f1ae-56ba-4a2f-8c90-4a385013bfeb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.559478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1279/2545] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:45 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:45.563388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816dc11-a352-40a1-80e1-38419ae7f80a admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.611770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1267/2546] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:45 2022] POST /identity/v3/users => generated 287 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:45.615609 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32f1ae-56ba-4a2f-8c90-4a385013bfeb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.629509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32f1ae-56ba-4a2f-8c90-4a385013bfeb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.641638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816dc11-a352-40a1-80e1-38419ae7f80a admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.646697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41b0f-68d0-4eb0-94c4-c02eee8848e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.647522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41b0f-68d0-4eb0-94c4-c02eee8848e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.647836 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41b0f-68d0-4eb0-94c4-c02eee8848e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.648206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a41b0f-68d0-4eb0-94c4-c02eee8848e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.648884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a41b0f-68d0-4eb0-94c4-c02eee8848e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.650825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a41b0f-68d0-4eb0-94c4-c02eee8848e2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.687182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd5e6-3470-4fa3-ab5c-5e213e90d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.687878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd5e6-3470-4fa3-ab5c-5e213e90d500 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.688205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd5e6-3470-4fa3-ab5c-5e213e90d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.688482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dd5e6-3470-4fa3-ab5c-5e213e90d500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.689138 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dd5e6-3470-4fa3-ab5c-5e213e90d500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.691576 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dd5e6-3470-4fa3-ab5c-5e213e90d500 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.713271 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1268/2547] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:19:45.729312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd5e6-3470-4fa3-ab5c-5e213e90d500 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.738076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1280/2548] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:45 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:45.741305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41b0f-68d0-4eb0-94c4-c02eee8848e2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.750504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dd5e6-3470-4fa3-ab5c-5e213e90d500 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.756524 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcfd09-9b01-4856-8224-31bf3500b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.757197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfd09-9b01-4856-8224-31bf3500b54f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.757482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfd09-9b01-4856-8224-31bf3500b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.757755 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcfd09-9b01-4856-8224-31bf3500b54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.762431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcfd09-9b01-4856-8224-31bf3500b54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.762728 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a41b0f-68d0-4eb0-94c4-c02eee8848e2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.762822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcfd09-9b01-4856-8224-31bf3500b54f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.766128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a71ee7-98b5-4f5f-b974-c200e711c418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.766445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71ee7-98b5-4f5f-b974-c200e711c418 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.766774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71ee7-98b5-4f5f-b974-c200e711c418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.767086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a71ee7-98b5-4f5f-b974-c200e711c418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.767839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a71ee7-98b5-4f5f-b974-c200e711c418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.770593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a71ee7-98b5-4f5f-b974-c200e711c418 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.772617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1269/2549] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:19:45.777025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcfd09-9b01-4856-8224-31bf3500b54f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.782968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1281/2550] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:45.788128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a71ee7-98b5-4f5f-b974-c200e711c418 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.788283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcfd09-9b01-4856-8224-31bf3500b54f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.797310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975c91c-e652-42fa-bd78-bb7e87554296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.798211 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975c91c-e652-42fa-bd78-bb7e87554296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.798448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975c91c-e652-42fa-bd78-bb7e87554296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.798730 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975c91c-e652-42fa-bd78-bb7e87554296 admin admin] PATH_INFO: `/v3/projects/3c861155243b473b9269dd1076e46fa9/users/3d41884785b94114ac36ae1f833121b0/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.806295 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a71ee7-98b5-4f5f-b974-c200e711c418 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.811239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501fc27-eafe-4d01-b42b-04a93991d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.811809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501fc27-eafe-4d01-b42b-04a93991d475 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.812113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501fc27-eafe-4d01-b42b-04a93991d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.812368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501fc27-eafe-4d01-b42b-04a93991d475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.813010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501fc27-eafe-4d01-b42b-04a93991d475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.814595 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501fc27-eafe-4d01-b42b-04a93991d475 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.815285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975c91c-e652-42fa-bd78-bb7e87554296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c861155243b473b9269dd1076e46fa9, user_id=3d41884785b94114ac36ae1f833121b0, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.817911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975c91c-e652-42fa-bd78-bb7e87554296 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.825075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1282/2551] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:45.829202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501fc27-eafe-4d01-b42b-04a93991d475 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:45.842073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501fc27-eafe-4d01-b42b-04a93991d475 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:45.847531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3be81-c259-471d-9ead-2b9f9e418c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:45.848455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3be81-c259-471d-9ead-2b9f9e418c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.848742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3be81-c259-471d-9ead-2b9f9e418c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.849022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3be81-c259-471d-9ead-2b9f9e418c79 admin admin] PATH_INFO: `/v3/projects/4908ad5e621547348bfba79774f19400/users/5f07c3cedbb2475192df0a304f802f69/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.867342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3be81-c259-471d-9ead-2b9f9e418c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4908ad5e621547348bfba79774f19400, user_id=5f07c3cedbb2475192df0a304f802f69, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:45.870381 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3be81-c259-471d-9ead-2b9f9e418c79 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:45.917011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1270/2552] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:45 2022] PUT /identity/v3/projects/3c861155243b473b9269dd1076e46fa9/users/3d41884785b94114ac36ae1f833121b0/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:45.922257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a43e7-c7b6-4b38-9d09-ee7a830d17f7 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:45.922591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a43e7-c7b6-4b38-9d09-ee7a830d17f7 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:45.922865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a43e7-c7b6-4b38-9d09-ee7a830d17f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:45.944158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c59a43e7-c7b6-4b38-9d09-ee7a830d17f7 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:45.945391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c59a43e7-c7b6-4b38-9d09-ee7a830d17f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:45.994311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1283/2553] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:45 2022] PUT /identity/v3/projects/4908ad5e621547348bfba79774f19400/users/5f07c3cedbb2475192df0a304f802f69/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:46.006311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adc864-b9ac-4646-b636-4498d463f814 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.006596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adc864-b9ac-4646-b636-4498d463f814 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.009703 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adc864-b9ac-4646-b636-4498d463f814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.009822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1271/2554] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:46.019290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a43e7-c7b6-4b38-9d09-ee7a830d17f7 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.020732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c59a43e7-c7b6-4b38-9d09-ee7a830d17f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:46.036480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-34adc864-b9ac-4646-b636-4498d463f814 None None] MFA Rules not processed for user `5f07c3cedbb2475192df0a304f802f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:46.037797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-34adc864-b9ac-4646-b636-4498d463f814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:46.118998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1284/2555] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:46.120582 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adc864-b9ac-4646-b636-4498d463f814 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.122794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a43e7-c7b6-4b38-9d09-ee7a830d17f7 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:46.196899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3623d63-cc58-4cb3-bf70-f89d97f1803c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:46.197569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623d63-cc58-4cb3-bf70-f89d97f1803c service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.197881 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623d63-cc58-4cb3-bf70-f89d97f1803c service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.198181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623d63-cc58-4cb3-bf70-f89d97f1803c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.212599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adc864-b9ac-4646-b636-4498d463f814 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:46.213900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3623d63-cc58-4cb3-bf70-f89d97f1803c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:46.216515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3623d63-cc58-4cb3-bf70-f89d97f1803c service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:46.229190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1272/2556] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:46.233322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:46.234245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.234597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.235027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.236431 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:46.238953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:46.333478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1285/2557] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:46 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:46.336323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3623d63-cc58-4cb3-bf70-f89d97f1803c service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.346144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3623d63-cc58-4cb3-bf70-f89d97f1803c service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:46.406608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.409072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:46.409761 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113a75-7c3e-47ee-9f06-f8c27d7651b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:46.410400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113a75-7c3e-47ee-9f06-f8c27d7651b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.410684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113a75-7c3e-47ee-9f06-f8c27d7651b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.410959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8113a75-7c3e-47ee-9f06-f8c27d7651b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.411610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8113a75-7c3e-47ee-9f06-f8c27d7651b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:46.413711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8113a75-7c3e-47ee-9f06-f8c27d7651b6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:46.417844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:46.432040 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aed0e-316f-43bf-9d54-3722739339c9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:46.437169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:46.437792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.438073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.438343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] PATH_INFO: `/v3/users/2b1d4f266a6f446e81296e09814ea802` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.439478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1d4f266a6f446e81296e09814ea802)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:46.442278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:46.533802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1273/2558] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:46 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:46.536463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113a75-7c3e-47ee-9f06-f8c27d7651b6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.550071 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8113a75-7c3e-47ee-9f06-f8c27d7651b6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:46.556485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b2b95-5c17-4ef5-99dd-761da110244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:46.557126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b2b95-5c17-4ef5-99dd-761da110244c admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.557392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b2b95-5c17-4ef5-99dd-761da110244c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.557673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b2b95-5c17-4ef5-99dd-761da110244c admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.558768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b2b95-5c17-4ef5-99dd-761da110244c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:46.560720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b2b95-5c17-4ef5-99dd-761da110244c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:46.573026 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1274/2559] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:46.576812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b2b95-5c17-4ef5-99dd-761da110244c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.594922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b2b95-5c17-4ef5-99dd-761da110244c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:46.601440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:46.602125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.602710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.602960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] PATH_INFO: `/v3/projects/eb23ca89b7ad4e4592cce7422d03bae9/users/30f8b8a4a0e841f9b2c5464a719faf5f/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.619128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb23ca89b7ad4e4592cce7422d03bae9, user_id=30f8b8a4a0e841f9b2c5464a719faf5f, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:46.622444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:46.649416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1d4f266a6f446e81296e09814ea802'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:46.650061 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1d4f266a6f446e81296e09814ea802'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:46.718353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1275/2560] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:46 2022] PUT /identity/v3/projects/eb23ca89b7ad4e4592cce7422d03bae9/users/30f8b8a4a0e841f9b2c5464a719faf5f/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:46.723240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.724973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:46.764467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1d4f266a6f446e81296e09814ea802'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:46.765193 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1d4f266a6f446e81296e09814ea802'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:46.781749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2ebbe15a-47dc-4f47-aacd-4d5e03f7397f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1d4f266a6f446e81296e09814ea802'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:46.793289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb5dd6-98cf-41d0-9c56-806a4cdb6bff admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:46.798172 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1286/2561] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:46 2022] DELETE /identity/v3/users/2b1d4f266a6f446e81296e09814ea802 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:46.798323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66207a4-7c6d-436f-94ae-5516aeaf87bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:46.798612 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66207a4-7c6d-436f-94ae-5516aeaf87bc admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.798883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66207a4-7c6d-436f-94ae-5516aeaf87bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.799161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66207a4-7c6d-436f-94ae-5516aeaf87bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.800704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66207a4-7c6d-436f-94ae-5516aeaf87bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:46.802777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66207a4-7c6d-436f-94ae-5516aeaf87bc admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:46.803579 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081019c6-4b64-4290-9e4c-340cd8590ece None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.803890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081019c6-4b64-4290-9e4c-340cd8590ece None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.804164 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081019c6-4b64-4290-9e4c-340cd8590ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.828507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-081019c6-4b64-4290-9e4c-340cd8590ece None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:46.829911 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1276/2562] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:46.834087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-081019c6-4b64-4290-9e4c-340cd8590ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:46.834759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66207a4-7c6d-436f-94ae-5516aeaf87bc admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.845946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:46.855481 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66207a4-7c6d-436f-94ae-5516aeaf87bc admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:46.913644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1287/2563] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:46.929579 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081019c6-4b64-4290-9e4c-340cd8590ece None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:46.931011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-081019c6-4b64-4290-9e4c-340cd8590ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:46.953357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f0f7-efca-4a56-a3bd-376d04573367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:46.954051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f0f7-efca-4a56-a3bd-376d04573367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.954373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f0f7-efca-4a56-a3bd-376d04573367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.954711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f0f7-efca-4a56-a3bd-376d04573367 admin admin] PATH_INFO: `/v3/projects/eb23ca89b7ad4e4592cce7422d03bae9/users/30f8b8a4a0e841f9b2c5464a719faf5f/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:46.956979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f0f7-efca-4a56-a3bd-376d04573367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb23ca89b7ad4e4592cce7422d03bae9, user_id=30f8b8a4a0e841f9b2c5464a719faf5f, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:46.959712 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f0f7-efca-4a56-a3bd-376d04573367 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:46.971217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1277/2564] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:46 2022] PUT /identity/v3/projects/eb23ca89b7ad4e4592cce7422d03bae9/users/30f8b8a4a0e841f9b2c5464a719faf5f/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:46.982163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59f1e-4feb-4318-9ea9-cce6466cff01 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:46.982435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59f1e-4feb-4318-9ea9-cce6466cff01 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:46.982720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e59f1e-4feb-4318-9ea9-cce6466cff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:47.058787 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-94e59f1e-4feb-4318-9ea9-cce6466cff01 None None] MFA Rules not processed for user `30f8b8a4a0e841f9b2c5464a719faf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:47.060658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-94e59f1e-4feb-4318-9ea9-cce6466cff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:47.075952 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081019c6-4b64-4290-9e4c-340cd8590ece None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:47.140813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:47.141442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:47.141726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:47.142198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:47.175710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1278/2565] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:47.188458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e59f1e-4feb-4318-9ea9-cce6466cff01 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:47.191937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-94e59f1e-4feb-4318-9ea9-cce6466cff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:47.273940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e59f1e-4feb-4318-9ea9-cce6466cff01 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:47.279255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d64d93-2054-4b8c-91d1-2c8d1a8f43a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:47.280046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d64d93-2054-4b8c-91d1-2c8d1a8f43a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:47.280917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d64d93-2054-4b8c-91d1-2c8d1a8f43a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:47.281322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d64d93-2054-4b8c-91d1-2c8d1a8f43a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:47.285992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-83d64d93-2054-4b8c-91d1-2c8d1a8f43a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:47.290851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:47.292413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:47.304605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1288/2566] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:47.367600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d64d93-2054-4b8c-91d1-2c8d1a8f43a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:47.369113 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d64d93-2054-4b8c-91d1-2c8d1a8f43a6 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:47.379509 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1279/2567] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:47.945161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:47.946594 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:47.948306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0093bd-f5e0-487b-846e-0f1890fa2d78 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:47.949145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0093bd-f5e0-487b-846e-0f1890fa2d78 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:47.949676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0093bd-f5e0-487b-846e-0f1890fa2d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:47.963143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9efcd1-a486-4bd1-a70e-a6c0eb9d0816 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:47.967160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:47.967832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:47.968121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:47.978808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] PATH_INFO: `/v3/projects/5bdafcb3887f46ae9c259ea4b1b0864f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:47.978808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdafcb3887f46ae9c259ea4b1b0864f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:47.978808 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:47.986570 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-bd0093bd-f5e0-487b-846e-0f1890fa2d78 None None] MFA Rules not processed for user `3d41884785b94114ac36ae1f833121b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:47.989018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bd0093bd-f5e0-487b-846e-0f1890fa2d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:48.058274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1280/2568] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:48.138953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdafcb3887f46ae9c259ea4b1b0864f', 'request_id': 'req-31416d8b-f91c-4e16-81d4-dd76990a44f9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.251133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdafcb3887f46ae9c259ea4b1b0864f', 'request_id': 'req-31416d8b-f91c-4e16-81d4-dd76990a44f9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.261813 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdafcb3887f46ae9c259ea4b1b0864f', 'request_id': 'req-31416d8b-f91c-4e16-81d4-dd76990a44f9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.276273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] The token cache is being invalidate because project 5bdafcb3887f46ae9c259ea4b1b0864f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:48.276591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.279127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.282210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1289/2569] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:47 2022] DELETE /identity/v3/projects/5bdafcb3887f46ae9c259ea4b1b0864f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:48.286511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0093bd-f5e0-487b-846e-0f1890fa2d78 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:48.297962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0093bd-f5e0-487b-846e-0f1890fa2d78 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:48.366974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:48.368754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:48.386498 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:48.387186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:48.387469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:48.387756 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] PATH_INFO: `/v3/users/fcddadf64e8f471ab7446fa612d4f648` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:48.389004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcddadf64e8f471ab7446fa612d4f648)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:48.391699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:48.450044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31416d8b-f91c-4e16-81d4-dd76990a44f9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:48.455152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:48.455880 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:48.456668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:48.456938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] PATH_INFO: `/v3/users/0cd163fdd7cf485696bff3395b7781b6` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:48.458104 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd163fdd7cf485696bff3395b7781b6)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:48.460123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:48.464653 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:48.624463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcddadf64e8f471ab7446fa612d4f648'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.669143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd163fdd7cf485696bff3395b7781b6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.669798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd163fdd7cf485696bff3395b7781b6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.747948 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcddadf64e8f471ab7446fa612d4f648'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.748617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcddadf64e8f471ab7446fa612d4f648'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.765166 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcddadf64e8f471ab7446fa612d4f648'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.765892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcddadf64e8f471ab7446fa612d4f648'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.781687 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1281/2570] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:48 2022] DELETE /identity/v3/users/fcddadf64e8f471ab7446fa612d4f648 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:48.782650 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:48.784910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:48.856719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd163fdd7cf485696bff3395b7781b6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.857361 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd163fdd7cf485696bff3395b7781b6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.862185 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331555c-9f62-4366-a168-b336b9ca67f0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:48.872258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-27c5597f-c037-4e22-af9e-b120b7c82218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd163fdd7cf485696bff3395b7781b6'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:48.872577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:48.873222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:48.873501 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:48.873775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:48.876870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:48.903782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1290/2571] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:48 2022] DELETE /identity/v3/users/0cd163fdd7cf485696bff3395b7781b6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:48.908010 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d43cb-afa6-4e24-9c72-b7c69fa3d450 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:48.908660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d43cb-afa6-4e24-9c72-b7c69fa3d450 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:48.910022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d43cb-afa6-4e24-9c72-b7c69fa3d450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:48.937189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3c3d43cb-afa6-4e24-9c72-b7c69fa3d450 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:48.938778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3c3d43cb-afa6-4e24-9c72-b7c69fa3d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:48.948706 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:48.961983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:48.963432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:48.974038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1282/2572] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:49.021124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1291/2573] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:49.033011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:49.041371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:49.116107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32aa7-cd5b-4b17-8fc3-dec77e81f0dd service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:49.212564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d3ec1-7762-4ab1-9986-85d453721917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:49.213130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3ec1-7762-4ab1-9986-85d453721917 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:49.213425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3ec1-7762-4ab1-9986-85d453721917 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:49.213699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d3ec1-7762-4ab1-9986-85d453721917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:49.224482 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d3ec1-7762-4ab1-9986-85d453721917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:49.228150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d3ec1-7762-4ab1-9986-85d453721917 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:49.241700 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1283/2574] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:49.333453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d43cb-afa6-4e24-9c72-b7c69fa3d450 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:49.336037 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3c3d43cb-afa6-4e24-9c72-b7c69fa3d450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:49.362853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d43cb-afa6-4e24-9c72-b7c69fa3d450 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:49.367820 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:49.368479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:49.368934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:49.369201 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] PATH_INFO: `/v3/projects/eb2358688ae9481a8343263f508df364` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:49.370378 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2358688ae9481a8343263f508df364)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:49.373538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:49.539204 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2358688ae9481a8343263f508df364', 'request_id': 'req-9caa0057-3b97-4dbc-83f6-de569913529f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:49.600744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2358688ae9481a8343263f508df364', 'request_id': 'req-9caa0057-3b97-4dbc-83f6-de569913529f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:49.607945 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2358688ae9481a8343263f508df364', 'request_id': 'req-9caa0057-3b97-4dbc-83f6-de569913529f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:49.629128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] The token cache is being invalidate because project eb2358688ae9481a8343263f508df364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:49.629517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:49.630347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9caa0057-3b97-4dbc-83f6-de569913529f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:49.634170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1292/2575] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:49 2022] DELETE /identity/v3/projects/eb2358688ae9481a8343263f508df364 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:49.636929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4907-7144-4f47-8902-0584bc4716d5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:49.637214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4907-7144-4f47-8902-0584bc4716d5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:49.637492 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da4907-7144-4f47-8902-0584bc4716d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:49.662444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-65da4907-7144-4f47-8902-0584bc4716d5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:49.663697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-65da4907-7144-4f47-8902-0584bc4716d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:49.772710 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1284/2576] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:49.780957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bc4f5-5a37-4d5e-aae1-0a027c75136f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:49.781323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bc4f5-5a37-4d5e-aae1-0a027c75136f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:49.781717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bc4f5-5a37-4d5e-aae1-0a027c75136f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:49.806117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07d14-8c68-486c-a2d8-d12cea2e65dc None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:49.808803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07d14-8c68-486c-a2d8-d12cea2e65dc None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:49.808803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e07d14-8c68-486c-a2d8-d12cea2e65dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:49.827894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-04e07d14-8c68-486c-a2d8-d12cea2e65dc None None] MFA Rules not processed for user `0dbda21789f3435ca697068d5caa8cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:49.828482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6c4bc4f5-5a37-4d5e-aae1-0a027c75136f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:49.830193 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-04e07d14-8c68-486c-a2d8-d12cea2e65dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:49.830324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6c4bc4f5-5a37-4d5e-aae1-0a027c75136f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:49.849732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1293/2577] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:49.851183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bc4f5-5a37-4d5e-aae1-0a027c75136f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:49.883006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bc4f5-5a37-4d5e-aae1-0a027c75136f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:49.895093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:49.895093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:49.895093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:49.895093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:49.897238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:49.899113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:49.903538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:49.923064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:49.950159 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1294/2578] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:49.952421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:49.955492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:49.975609 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd204d-95af-4f5d-ad75-1a7ec43a59d9 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:49.984156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1285/2579] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:49.984156 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e07d14-8c68-486c-a2d8-d12cea2e65dc None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:49.987298 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:49.988177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:49.988958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:49.989248 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] PATH_INFO: `/v3/projects/65592f46266a47b1b3b137e10295545a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:49.990635 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65592f46266a47b1b3b137e10295545a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:49.999180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.027623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e07d14-8c68-486c-a2d8-d12cea2e65dc None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.033316 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.033974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.034255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.034532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.035646 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.037291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.168716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1286/2580] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:49 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:50.169200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65592f46266a47b1b3b137e10295545a', 'request_id': 'req-b142264f-8a70-4dd3-bb90-0a5541bf3154'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.173874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.173874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.235286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65592f46266a47b1b3b137e10295545a', 'request_id': 'req-b142264f-8a70-4dd3-bb90-0a5541bf3154'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.244412 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65592f46266a47b1b3b137e10295545a', 'request_id': 'req-b142264f-8a70-4dd3-bb90-0a5541bf3154'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.256256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] The token cache is being invalidate because project 65592f46266a47b1b3b137e10295545a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:50.256550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.257372 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.259134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1295/2581] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:49 2022] DELETE /identity/v3/projects/65592f46266a47b1b3b137e10295545a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:50.259396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf863c0f-a264-4504-b01a-4788e59d53db admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.260748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.262481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.265429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.266067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.266346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.266620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] PATH_INFO: `/v3/users/309b830ddcf845869ad25a327498011e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.268280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=309b830ddcf845869ad25a327498011e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.270815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.342652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142264f-8a70-4dd3-bb90-0a5541bf3154 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.347405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.348041 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.348321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.348615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.349208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.351099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.509043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1296/2582] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:50 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:50.509906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.511519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.521183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309b830ddcf845869ad25a327498011e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.570544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b54a57-f283-48ad-b0ce-f8296ff6f1aa admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.574894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d681b5-0760-4a63-a002-fcfc4ec7a68c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.575227 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d681b5-0760-4a63-a002-fcfc4ec7a68c service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.575527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d681b5-0760-4a63-a002-fcfc4ec7a68c service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.575830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d681b5-0760-4a63-a002-fcfc4ec7a68c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.577633 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c1d681b5-0760-4a63-a002-fcfc4ec7a68c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.594297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309b830ddcf845869ad25a327498011e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.595235 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309b830ddcf845869ad25a327498011e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.611110 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309b830ddcf845869ad25a327498011e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.611858 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0471b2c2-6ab6-4ea5-ad6a-447179f95451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309b830ddcf845869ad25a327498011e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:50.626278 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1287/2583] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:50 2022] DELETE /identity/v3/users/309b830ddcf845869ad25a327498011e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:50.628412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e18b5-04c1-425d-b15c-ac5763b8f960 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.628713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e18b5-04c1-425d-b15c-ac5763b8f960 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.629005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e18b5-04c1-425d-b15c-ac5763b8f960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.648538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d681b5-0760-4a63-a002-fcfc4ec7a68c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.649303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-534e18b5-04c1-425d-b15c-ac5763b8f960 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:50.650466 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-534e18b5-04c1-425d-b15c-ac5763b8f960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.650843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d681b5-0760-4a63-a002-fcfc4ec7a68c service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.661087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1297/2584] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:50.662325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d420a0-31d3-47e5-a663-461bc7253527 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.662616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d420a0-31d3-47e5-a663-461bc7253527 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.662897 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d420a0-31d3-47e5-a663-461bc7253527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-28d420a0-31d3-47e5-a663-461bc7253527 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:19:50.669291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:50.670493 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:19:50.671658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1298/2585] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:19:50 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:19:50.671658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d420a0-31d3-47e5-a663-461bc7253527 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.673474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-28d420a0-31d3-47e5-a663-461bc7253527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.722362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:50.734686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1288/2586] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:50.736638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8501f6-8817-4f1e-8df1-96422e9c8da2 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.738240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8501f6-8817-4f1e-8df1-96422e9c8da2 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.738744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8501f6-8817-4f1e-8df1-96422e9c8da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.769246 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-7a8501f6-8817-4f1e-8df1-96422e9c8da2 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:50.770964 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7a8501f6-8817-4f1e-8df1-96422e9c8da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.785134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1289/2587] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:50.787941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452729d6-ee93-45dc-aec1-1d0050b9c021 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.788416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452729d6-ee93-45dc-aec1-1d0050b9c021 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.791405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452729d6-ee93-45dc-aec1-1d0050b9c021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.807763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d420a0-31d3-47e5-a663-461bc7253527 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.829998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3bf84-1c53-4480-96c8-bac05c78067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.829998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3bf84-1c53-4480-96c8-bac05c78067c admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.830438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-452729d6-ee93-45dc-aec1-1d0050b9c021 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:50.830598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3bf84-1c53-4480-96c8-bac05c78067c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.830598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3bf84-1c53-4480-96c8-bac05c78067c admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.830919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-452729d6-ee93-45dc-aec1-1d0050b9c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.831093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3bf84-1c53-4480-96c8-bac05c78067c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.831093 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3bf84-1c53-4480-96c8-bac05c78067c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.831400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1290/2588] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:50.831400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452729d6-ee93-45dc-aec1-1d0050b9c021 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.832310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-452729d6-ee93-45dc-aec1-1d0050b9c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:50.835993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1299/2589] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:50.840264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3bf84-1c53-4480-96c8-bac05c78067c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.851315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3bf84-1c53-4480-96c8-bac05c78067c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.858422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.866080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.866080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.866080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.866080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:50.866080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.866080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.875782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1300/2590] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:19:50.876598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.887748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4cf8-bad1-4225-a3ee-b0f55cc2e642 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.892804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce4bc-6584-45a3-9e1e-d369ad6c8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.893455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce4bc-6584-45a3-9e1e-d369ad6c8b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.893755 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce4bc-6584-45a3-9e1e-d369ad6c8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.894064 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce4bc-6584-45a3-9e1e-d369ad6c8b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.894737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce4bc-6584-45a3-9e1e-d369ad6c8b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.896447 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce4bc-6584-45a3-9e1e-d369ad6c8b84 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.904374 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452729d6-ee93-45dc-aec1-1d0050b9c021 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.907803 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1301/2591] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:50.908254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb99d0b-7fd9-4eda-872b-edd6b8aed366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.911372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb99d0b-7fd9-4eda-872b-edd6b8aed366 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.911520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce4bc-6584-45a3-9e1e-d369ad6c8b84 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.911623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb99d0b-7fd9-4eda-872b-edd6b8aed366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.911623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb99d0b-7fd9-4eda-872b-edd6b8aed366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.920955 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb99d0b-7fd9-4eda-872b-edd6b8aed366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.921744 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce4bc-6584-45a3-9e1e-d369ad6c8b84 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.923017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb99d0b-7fd9-4eda-872b-edd6b8aed366 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.927604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c29853-e56e-43e6-8d57-ce94eb59359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.928336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c29853-e56e-43e6-8d57-ce94eb59359f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.928620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c29853-e56e-43e6-8d57-ce94eb59359f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.928920 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c29853-e56e-43e6-8d57-ce94eb59359f admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.929673 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c29853-e56e-43e6-8d57-ce94eb59359f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.931605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c29853-e56e-43e6-8d57-ce94eb59359f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:50.936354 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1291/2592] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:50.937205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb99d0b-7fd9-4eda-872b-edd6b8aed366 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:50.947123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb99d0b-7fd9-4eda-872b-edd6b8aed366 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:50.958073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea9d3-bc12-4cd0-a91f-85f6e14f6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:50.958073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea9d3-bc12-4cd0-a91f-85f6e14f6ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:50.958073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea9d3-bc12-4cd0-a91f-85f6e14f6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:50.958073 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea9d3-bc12-4cd0-a91f-85f6e14f6ddd admin admin] PATH_INFO: `/v3/projects/26c7606500fe406197ac6d61a943c5f2/users/91dec5d881064e658beec2067a4d26eb/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:50.973043 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea9d3-bc12-4cd0-a91f-85f6e14f6ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c7606500fe406197ac6d61a943c5f2, user_id=91dec5d881064e658beec2067a4d26eb, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:50.976414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea9d3-bc12-4cd0-a91f-85f6e14f6ddd admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:51.063910 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1302/2593] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:50 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:51.068866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c29853-e56e-43e6-8d57-ce94eb59359f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:51.120030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1292/2594] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:50 2022] PUT /identity/v3/projects/26c7606500fe406197ac6d61a943c5f2/users/91dec5d881064e658beec2067a4d26eb/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:51.131751 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c29853-e56e-43e6-8d57-ce94eb59359f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:51.132833 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f393-9b53-464b-a9ed-1f2206c24dd6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.133201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f393-9b53-464b-a9ed-1f2206c24dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.133677 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7f393-9b53-464b-a9ed-1f2206c24dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.166500 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1dc7f393-9b53-464b-a9ed-1f2206c24dd6 None None] MFA Rules not processed for user `91dec5d881064e658beec2067a4d26eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:51.167781 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1dc7f393-9b53-464b-a9ed-1f2206c24dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:51.189181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab750d2e-5883-4dc2-9dce-4d26472504ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:51.189787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab750d2e-5883-4dc2-9dce-4d26472504ae admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.190068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab750d2e-5883-4dc2-9dce-4d26472504ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.191112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab750d2e-5883-4dc2-9dce-4d26472504ae admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.191854 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab750d2e-5883-4dc2-9dce-4d26472504ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:51.209347 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab750d2e-5883-4dc2-9dce-4d26472504ae admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:51.263845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1293/2595] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:51.346635 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1303/2596] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:51 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:51.350029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f393-9b53-464b-a9ed-1f2206c24dd6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:51.363128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7f393-9b53-464b-a9ed-1f2206c24dd6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:51.379470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df05e8-9e2f-4d70-a1b2-9d8e29d79e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:51.380178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df05e8-9e2f-4d70-a1b2-9d8e29d79e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.380487 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df05e8-9e2f-4d70-a1b2-9d8e29d79e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.380734 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df05e8-9e2f-4d70-a1b2-9d8e29d79e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.381396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df05e8-9e2f-4d70-a1b2-9d8e29d79e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:51.383017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df05e8-9e2f-4d70-a1b2-9d8e29d79e7b admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:51.394152 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1294/2597] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:51.398461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab750d2e-5883-4dc2-9dce-4d26472504ae admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:51.408791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab750d2e-5883-4dc2-9dce-4d26472504ae admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:51.414129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:51.414745 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.415027 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.415302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.416002 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:51.417602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:51.433856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1304/2598] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:19:51.435423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df05e8-9e2f-4d70-a1b2-9d8e29d79e7b admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:51.446329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df05e8-9e2f-4d70-a1b2-9d8e29d79e7b admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:51.451099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d978b-536f-4bf5-a23b-9bc0e09e85bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:51.451788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d978b-536f-4bf5-a23b-9bc0e09e85bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.452072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d978b-536f-4bf5-a23b-9bc0e09e85bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.452370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d978b-536f-4bf5-a23b-9bc0e09e85bb admin admin] PATH_INFO: `/v3/projects/f699f5cce124433bbf23463d825dde7b/users/0535a23daa2d4b8290bf1fd0bfaf37ed/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.467616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d978b-536f-4bf5-a23b-9bc0e09e85bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f699f5cce124433bbf23463d825dde7b, user_id=0535a23daa2d4b8290bf1fd0bfaf37ed, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:51.470300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d978b-536f-4bf5-a23b-9bc0e09e85bb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:51.510042 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:51.510713 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:51.520897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:51.532611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bc89c-9538-43f2-967c-9e66a3fbd97f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:51.548282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:51.548282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.548282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.548282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] PATH_INFO: `/v3/projects/fdad06cb6c9a429c83463a26cebd57db` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.548895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdad06cb6c9a429c83463a26cebd57db)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:51.548895 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:51.565333 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1295/2599] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:51 2022] PUT /identity/v3/projects/f699f5cce124433bbf23463d825dde7b/users/0535a23daa2d4b8290bf1fd0bfaf37ed/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:51.567098 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a4620-6fb8-4631-8f2f-fd9943616386 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.567409 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a4620-6fb8-4631-8f2f-fd9943616386 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.567648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a4620-6fb8-4631-8f2f-fd9943616386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.599902 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-6e2a4620-6fb8-4631-8f2f-fd9943616386 None None] MFA Rules not processed for user `0535a23daa2d4b8290bf1fd0bfaf37ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:51.601322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6e2a4620-6fb8-4631-8f2f-fd9943616386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:51.681703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1296/2600] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:51.682813 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a4620-6fb8-4631-8f2f-fd9943616386 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:51.684222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6e2a4620-6fb8-4631-8f2f-fd9943616386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:51.720879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdad06cb6c9a429c83463a26cebd57db', 'request_id': 'req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:51.748883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a4620-6fb8-4631-8f2f-fd9943616386 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:51.797425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097ee23-c67b-4596-8ea8-39345ee85711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:51.798040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ee23-c67b-4596-8ea8-39345ee85711 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.798321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ee23-c67b-4596-8ea8-39345ee85711 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.798597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ee23-c67b-4596-8ea8-39345ee85711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.829123 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdad06cb6c9a429c83463a26cebd57db', 'request_id': 'req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:51.838775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdad06cb6c9a429c83463a26cebd57db', 'request_id': 'req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:51.851197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] The token cache is being invalidate because project fdad06cb6c9a429c83463a26cebd57db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:51.851488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:51.852199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-a9ae1d48-b2f2-4a0b-be80-9a2188878cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:51.853953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1305/2601] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:51 2022] DELETE /identity/v3/projects/fdad06cb6c9a429c83463a26cebd57db => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:51.855356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ce89-be99-497a-88d4-fc49088a3d23 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.855615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ce89-be99-497a-88d4-fc49088a3d23 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.855917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6ce89-be99-497a-88d4-fc49088a3d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.863526 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097ee23-c67b-4596-8ea8-39345ee85711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:51.865118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097ee23-c67b-4596-8ea8-39345ee85711 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:51.875554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1297/2602] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:51.876299 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097ee23-c67b-4596-8ea8-39345ee85711 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:51.877443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8ff6ce89-be99-497a-88d4-fc49088a3d23 None None] MFA Rules not processed for user `3d41884785b94114ac36ae1f833121b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:51.879606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8ff6ce89-be99-497a-88d4-fc49088a3d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:51.945195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1306/2603] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:51.951447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097ee23-c67b-4596-8ea8-39345ee85711 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:51.958689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:51.959397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:51.959845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:51.960308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] PATH_INFO: `/v3/users/54f03877b7194a77820cc56b96d67dcc` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:51.962207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f03877b7194a77820cc56b96d67dcc)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:51.965652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:52.199191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb62c-d7c3-4ea0-8a33-e2c7da0265da None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:52.199788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb62c-d7c3-4ea0-8a33-e2c7da0265da None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:52.199788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbb62c-d7c3-4ea0-8a33-e2c7da0265da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-e5fbb62c-d7c3-4ea0-8a33-e2c7da0265da None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:19:52.207157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:52.208362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:19:52.209590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1307/2604] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:19:52 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 19:19:52.239017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6017-ecc6-49d0-be1c-c656a8e5c2cc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:52.239017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6017-ecc6-49d0-be1c-c656a8e5c2cc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:52.239017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6017-ecc6-49d0-be1c-c656a8e5c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:52.256788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8a1d6017-ecc6-49d0-be1c-c656a8e5c2cc None None] MFA Rules not processed for user `3d41884785b94114ac36ae1f833121b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:52.257999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8a1d6017-ecc6-49d0-be1c-c656a8e5c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:52.266753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1308/2605] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:52.282118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f03877b7194a77820cc56b96d67dcc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:52.348040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f03877b7194a77820cc56b96d67dcc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:52.348835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f03877b7194a77820cc56b96d67dcc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:52.364133 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f03877b7194a77820cc56b96d67dcc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:52.364865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-452e791f-39fc-4169-a6ec-1204a0579666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f03877b7194a77820cc56b96d67dcc'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:52.377538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1298/2606] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:51 2022] DELETE /identity/v3/users/54f03877b7194a77820cc56b96d67dcc => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:52.649929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6017-ecc6-49d0-be1c-c656a8e5c2cc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:52.651349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8a1d6017-ecc6-49d0-be1c-c656a8e5c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:52.665229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6017-ecc6-49d0-be1c-c656a8e5c2cc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:52.737690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:52.738917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:52.739210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:52.739490 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:52.741869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:52.783009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81a553-7538-4498-8a5d-aee81213001d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:52.783518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81a553-7538-4498-8a5d-aee81213001d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:52.784173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81a553-7538-4498-8a5d-aee81213001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4f81a553-7538-4498-8a5d-aee81213001d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:19:52.793806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:19:52.794744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:19:52.798945 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1299/2607] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:19:52 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 29 19:19:52.837121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:52.837121 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:52.845878 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1309/2608] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:52.890557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81a553-7538-4498-8a5d-aee81213001d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:52.897126 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4f81a553-7538-4498-8a5d-aee81213001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:52.992003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81a553-7538-4498-8a5d-aee81213001d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:52.998290 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:52.999199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:52.999331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:52.999682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] PATH_INFO: `/v3/users/0535a23daa2d4b8290bf1fd0bfaf37ed` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.001028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0535a23daa2d4b8290bf1fd0bfaf37ed)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:53.004234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:53.046568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:53.048650 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:53.065747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589e130-e198-46b2-b807-6cf4873a8490 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:53.073806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:53.075246 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.075955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.076472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] PATH_INFO: `/v3/projects/13ad037210f345a4bdc07b75a47f4842` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.078266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ad037210f345a4bdc07b75a47f4842)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:53.081655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:53.245789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ad037210f345a4bdc07b75a47f4842', 'request_id': 'req-c10717d0-b6e6-42fc-889e-859dcf8bb771'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.246943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0535a23daa2d4b8290bf1fd0bfaf37ed'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.314132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ad037210f345a4bdc07b75a47f4842', 'request_id': 'req-c10717d0-b6e6-42fc-889e-859dcf8bb771'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.323593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ad037210f345a4bdc07b75a47f4842', 'request_id': 'req-c10717d0-b6e6-42fc-889e-859dcf8bb771'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.339390 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] The token cache is being invalidate because project 13ad037210f345a4bdc07b75a47f4842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:53.340405 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.341999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-c10717d0-b6e6-42fc-889e-859dcf8bb771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.344553 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1310/2609] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:53 2022] DELETE /identity/v3/projects/13ad037210f345a4bdc07b75a47f4842 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:53.362762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9450ece-bab6-4423-9395-6282cf45bb28 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.363548 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9450ece-bab6-4423-9395-6282cf45bb28 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.364134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9450ece-bab6-4423-9395-6282cf45bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.392592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f9450ece-bab6-4423-9395-6282cf45bb28 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:53.393867 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f9450ece-bab6-4423-9395-6282cf45bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:53.438926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0535a23daa2d4b8290bf1fd0bfaf37ed'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.440831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0535a23daa2d4b8290bf1fd0bfaf37ed'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.461884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0535a23daa2d4b8290bf1fd0bfaf37ed'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.463000 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f448e424-bbc5-45a3-bfb4-472186916ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0535a23daa2d4b8290bf1fd0bfaf37ed'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:53.465195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1311/2610] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:53.474773 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b680c2-da59-4e2e-b2a7-0d403b1a1b59 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.475462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b680c2-da59-4e2e-b2a7-0d403b1a1b59 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.476147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b680c2-da59-4e2e-b2a7-0d403b1a1b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.498573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-19b680c2-da59-4e2e-b2a7-0d403b1a1b59 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:53.500872 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-19b680c2-da59-4e2e-b2a7-0d403b1a1b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:53.511638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1300/2611] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:52 2022] DELETE /identity/v3/users/0535a23daa2d4b8290bf1fd0bfaf37ed => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:53.514048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1730-cdd1-439c-8625-924798b87bed None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.514349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1730-cdd1-439c-8625-924798b87bed None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.514636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc1730-cdd1-439c-8625-924798b87bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.521766 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1312/2612] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:53.537213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b680c2-da59-4e2e-b2a7-0d403b1a1b59 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:53.554606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b680c2-da59-4e2e-b2a7-0d403b1a1b59 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:53.556918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-54cc1730-cdd1-439c-8625-924798b87bed None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:53.559265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-54cc1730-cdd1-439c-8625-924798b87bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:53.614516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:53.650361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1301/2613] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:19:53.652410 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:53.653205 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.656775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.660753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.660753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:19:53.660753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:53.661994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:53.662744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1730-cdd1-439c-8625-924798b87bed None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:53.664493 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-54cc1730-cdd1-439c-8625-924798b87bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:53.682850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1313/2614] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 19:19:53.691519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:53.705299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb9ec7-4b77-45f7-bd7f-d5512948ec0c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:53.710772 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d255db-99fd-41d0-8b0c-ffea66e8472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:53.711507 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d255db-99fd-41d0-8b0c-ffea66e8472b admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.711981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d255db-99fd-41d0-8b0c-ffea66e8472b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.712341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d255db-99fd-41d0-8b0c-ffea66e8472b admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.712985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d255db-99fd-41d0-8b0c-ffea66e8472b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:53.715096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d255db-99fd-41d0-8b0c-ffea66e8472b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:53.739817 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc1730-cdd1-439c-8625-924798b87bed None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:53.743589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:53.744243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.744555 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.744859 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.755653 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:53.757154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:53.767414 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1302/2615] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:53.768962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:53.770450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:53.837763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1314/2616] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:19:53 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:19:53.839877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51e8f4-e1e6-4fe2-bd13-77ce61b2e8bb service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:53.842942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d255db-99fd-41d0-8b0c-ffea66e8472b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:53.912395 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:53.913047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.913336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.913613 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.917440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:53.937534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d255db-99fd-41d0-8b0c-ffea66e8472b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:53.943325 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505635d-c273-4a23-a98e-259c7acb563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:53.943972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505635d-c273-4a23-a98e-259c7acb563c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:53.944260 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505635d-c273-4a23-a98e-259c7acb563c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:53.944540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505635d-c273-4a23-a98e-259c7acb563c admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:53.945175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505635d-c273-4a23-a98e-259c7acb563c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:53.947198 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505635d-c273-4a23-a98e-259c7acb563c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:53.993747 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:53.995208 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:54.006335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1303/2617] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:54.087927 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1315/2618] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:19:53 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:19:54.091777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:54.103801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963d103-04ab-43c8-a274-0707dd8c0ac2 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:54.109727 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a531d1c-a73e-4d86-a09f-0f63eae64ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:54.110342 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531d1c-a73e-4d86-a09f-0f63eae64ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:54.110623 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531d1c-a73e-4d86-a09f-0f63eae64ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:54.113023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a531d1c-a73e-4d86-a09f-0f63eae64ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:54.113023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a531d1c-a73e-4d86-a09f-0f63eae64ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:54.114032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a531d1c-a73e-4d86-a09f-0f63eae64ad0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:54.128112 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1304/2619] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:54.134724 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505635d-c273-4a23-a98e-259c7acb563c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:54.163674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505635d-c273-4a23-a98e-259c7acb563c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:54.178621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:54.179525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:54.180102 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:54.185078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:54.186173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:54.188862 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:54.199843 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1316/2620] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:19:54.204984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a531d1c-a73e-4d86-a09f-0f63eae64ad0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:54.219255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a531d1c-a73e-4d86-a09f-0f63eae64ad0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:54.225317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2ad48-4c64-4a99-b20f-8426d94ca7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:54.225993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2ad48-4c64-4a99-b20f-8426d94ca7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:54.226275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2ad48-4c64-4a99-b20f-8426d94ca7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:54.226582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2ad48-4c64-4a99-b20f-8426d94ca7d4 admin admin] PATH_INFO: `/v3/projects/bc484c313f4e4b518f916617786b9a5e/users/1ee38a321f134250ae66120775d28050/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:54.243111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2ad48-4c64-4a99-b20f-8426d94ca7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc484c313f4e4b518f916617786b9a5e, user_id=1ee38a321f134250ae66120775d28050, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:54.245836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2ad48-4c64-4a99-b20f-8426d94ca7d4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:54.291740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:54.299969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:54.305446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:54.319712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433eead-9e0b-433c-80c7-3aa9879df45c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:54.326152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:54.326896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:54.327210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:54.327514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] PATH_INFO: `/v3/projects/f699f5cce124433bbf23463d825dde7b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:54.328882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f699f5cce124433bbf23463d825dde7b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:54.330811 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:54.337598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1305/2621] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:19:54 2022] PUT /identity/v3/projects/bc484c313f4e4b518f916617786b9a5e/users/1ee38a321f134250ae66120775d28050/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:54.353788 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c63a11-9083-4906-bad5-ebcca7f4e095 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:54.354223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c63a11-9083-4906-bad5-ebcca7f4e095 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:54.354510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c63a11-9083-4906-bad5-ebcca7f4e095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:54.413051 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-32c63a11-9083-4906-bad5-ebcca7f4e095 None None] MFA Rules not processed for user `1ee38a321f134250ae66120775d28050`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:54.416368 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-32c63a11-9083-4906-bad5-ebcca7f4e095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:54.489712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f699f5cce124433bbf23463d825dde7b', 'request_id': 'req-64cdfe53-6bee-472e-a7f6-16f97eef0526'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:54.515683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1306/2622] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:54.564301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f699f5cce124433bbf23463d825dde7b', 'request_id': 'req-64cdfe53-6bee-472e-a7f6-16f97eef0526'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:54.575896 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f699f5cce124433bbf23463d825dde7b', 'request_id': 'req-64cdfe53-6bee-472e-a7f6-16f97eef0526'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:54.577815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c63a11-9083-4906-bad5-ebcca7f4e095 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:54.589944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] The token cache is being invalidate because project f699f5cce124433bbf23463d825dde7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:54.589944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:54.590615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:54.592471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1317/2623] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:54 2022] DELETE /identity/v3/projects/f699f5cce124433bbf23463d825dde7b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:19:54.666486 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c63a11-9083-4906-bad5-ebcca7f4e095 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:54.768113 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1aab-261c-466e-bc35-14b42c23042b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:54.770200 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1aab-261c-466e-bc35-14b42c23042b service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:54.770776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1aab-261c-466e-bc35-14b42c23042b service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:54.771461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1aab-261c-466e-bc35-14b42c23042b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:54.773982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7a3a1aab-261c-466e-bc35-14b42c23042b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:54.874171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a1aab-261c-466e-bc35-14b42c23042b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:54.875802 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a1aab-261c-466e-bc35-14b42c23042b service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:54.891769 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1307/2624] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:19:56.075535 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:56.343718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:56.834680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:56.837250 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:56.949238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdfe53-6bee-472e-a7f6-16f97eef0526 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:56.954637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:56.955305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:56.955589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:56.955904 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] PATH_INFO: `/v3/users/33f6c55bd9004139a0e907714a7e5315` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:56.957268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33f6c55bd9004139a0e907714a7e5315)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:56.959343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:57.220747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33f6c55bd9004139a0e907714a7e5315'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:57.221559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33f6c55bd9004139a0e907714a7e5315'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:57.338392 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33f6c55bd9004139a0e907714a7e5315'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:57.346090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33f6c55bd9004139a0e907714a7e5315'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:57.373453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33f6c55bd9004139a0e907714a7e5315'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:57.396370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1318/2625] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:56 2022] DELETE /identity/v3/users/33f6c55bd9004139a0e907714a7e5315 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:57.398518 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df893-9ddf-42c4-8593-0d5380b5bfe9 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:57.399044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df893-9ddf-42c4-8593-0d5380b5bfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:57.399321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df893-9ddf-42c4-8593-0d5380b5bfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:57.434435 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-dc3df893-9ddf-42c4-8593-0d5380b5bfe9 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:57.435617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dc3df893-9ddf-42c4-8593-0d5380b5bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:57.531273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1308/2626] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:57.543459 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:57.545058 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:57.618917 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de51e849-5e94-462b-b60d-e186a7a59f58 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:57.625264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c761f-b8fb-4903-95f5-5bac533a9bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:57.625934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c761f-b8fb-4903-95f5-5bac533a9bdb service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:57.626218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c761f-b8fb-4903-95f5-5bac533a9bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:57.626495 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c761f-b8fb-4903-95f5-5bac533a9bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:57.646453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c761f-b8fb-4903-95f5-5bac533a9bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:57.646453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c761f-b8fb-4903-95f5-5bac533a9bdb service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:57.651909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:57.657009 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1319/2627] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:57.924679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:58.201439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df893-9ddf-42c4-8593-0d5380b5bfe9 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:58.205416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-dc3df893-9ddf-42c4-8593-0d5380b5bfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:58.223834 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df893-9ddf-42c4-8593-0d5380b5bfe9 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:58.235446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:58.236229 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:58.236519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:58.236795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] PATH_INFO: `/v3/projects/fb1e711181a14ab6a186e91624db6516` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:58.240063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1e711181a14ab6a186e91624db6516)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:58.241923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:58.430020 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1e711181a14ab6a186e91624db6516', 'request_id': 'req-30b8b6c1-2773-49f4-a177-df962ebaa460'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:58.566391 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1e711181a14ab6a186e91624db6516', 'request_id': 'req-30b8b6c1-2773-49f4-a177-df962ebaa460'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:58.591895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1e711181a14ab6a186e91624db6516', 'request_id': 'req-30b8b6c1-2773-49f4-a177-df962ebaa460'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:58.608109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] The token cache is being invalidate because project fb1e711181a14ab6a186e91624db6516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:19:58.608401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:58.609611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-30b8b6c1-2773-49f4-a177-df962ebaa460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:58.614289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1309/2628] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:58 2022] DELETE /identity/v3/projects/fb1e711181a14ab6a186e91624db6516 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:58.618545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c761f-b8fb-4903-95f5-5bac533a9bdb service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:58.625335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be890504-10c4-487e-83da-a9eb49b3df4f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:58.625868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be890504-10c4-487e-83da-a9eb49b3df4f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:58.626308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be890504-10c4-487e-83da-a9eb49b3df4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:58.632787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c761f-b8fb-4903-95f5-5bac533a9bdb service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:58.649920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-be890504-10c4-487e-83da-a9eb49b3df4f None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:58.651177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-be890504-10c4-487e-83da-a9eb49b3df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:58.715784 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:58.723238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:58.724231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:58.724516 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:58.724966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] PATH_INFO: `/v3/users/813cc72e35ad4949a500e48aa9a2ff6e` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:58.726077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1310/2629] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:19:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:58.729551 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=813cc72e35ad4949a500e48aa9a2ff6e)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:58.733022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:58.760323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be890504-10c4-487e-83da-a9eb49b3df4f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:58.764939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-be890504-10c4-487e-83da-a9eb49b3df4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:58.863317 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be890504-10c4-487e-83da-a9eb49b3df4f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:58.869171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:58.869799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:58.870090 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:58.870367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:58.879980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:58.881588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:58.901701 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1311/2630] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:19:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 19:19:58.902697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:58.904187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:58.919496 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813cc72e35ad4949a500e48aa9a2ff6e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:58.920376 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813cc72e35ad4949a500e48aa9a2ff6e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:58.928300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf0dd-bba8-41fc-aa53-a1c2f9838eb7 service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:58.933272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:58.935080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:58.935080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:58.935080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] PATH_INFO: `/v3/users/1ee38a321f134250ae66120775d28050` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:58.936183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee38a321f134250ae66120775d28050)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:58.938477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:59.011464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813cc72e35ad4949a500e48aa9a2ff6e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:59.013116 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813cc72e35ad4949a500e48aa9a2ff6e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:59.066245 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-229b3ed0-9b68-4954-be6e-63453d5820c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813cc72e35ad4949a500e48aa9a2ff6e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:59.084482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1320/2631] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:58 2022] DELETE /identity/v3/users/813cc72e35ad4949a500e48aa9a2ff6e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:59.193682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee38a321f134250ae66120775d28050'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:59.267655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee38a321f134250ae66120775d28050'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:59.270334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee38a321f134250ae66120775d28050'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:59.287590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee38a321f134250ae66120775d28050'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:59.289303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee38a321f134250ae66120775d28050'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:19:59.308789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1312/2632] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:19:58 2022] DELETE /identity/v3/users/1ee38a321f134250ae66120775d28050 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:19:59.313351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6180de-7c90-4ed5-b97f-269c59439a57 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:59.313679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6180de-7c90-4ed5-b97f-269c59439a57 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:59.314180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6180de-7c90-4ed5-b97f-269c59439a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:59.338423 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2e6180de-7c90-4ed5-b97f-269c59439a57 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:19:59.339674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2e6180de-7c90-4ed5-b97f-269c59439a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:59.474760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:59.475596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1321/2633] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:19:59.476891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:59.571450 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:19:59.638525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cc3bc-78da-4d79-8229-d1a9467c80d3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:59.646377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83582002-a3f0-429a-82d0-687e1c7a08c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:59.647070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582002-a3f0-429a-82d0-687e1c7a08c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:59.647426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582002-a3f0-429a-82d0-687e1c7a08c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:59.647868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582002-a3f0-429a-82d0-687e1c7a08c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:59.663684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83582002-a3f0-429a-82d0-687e1c7a08c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:59.665219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83582002-a3f0-429a-82d0-687e1c7a08c7 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:19:59.678263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1313/2634] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:19:59.846577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6180de-7c90-4ed5-b97f-269c59439a57 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:19:59.848792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2e6180de-7c90-4ed5-b97f-269c59439a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:19:59.868476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6180de-7c90-4ed5-b97f-269c59439a57 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:19:59.885147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:19:59.886199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:19:59.886698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:19:59.887212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] PATH_INFO: `/v3/projects/e4968554bf8b46eb9c905bc01e777a6d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:19:59.889156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4968554bf8b46eb9c905bc01e777a6d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:19:59.891371 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:00.035155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4968554bf8b46eb9c905bc01e777a6d', 'request_id': 'req-9c58336a-368e-43f0-b4aa-ec9398756350'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:00.124709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4968554bf8b46eb9c905bc01e777a6d', 'request_id': 'req-9c58336a-368e-43f0-b4aa-ec9398756350'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:00.134637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4968554bf8b46eb9c905bc01e777a6d', 'request_id': 'req-9c58336a-368e-43f0-b4aa-ec9398756350'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:00.158454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:00.161230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] The token cache is being invalidate because project e4968554bf8b46eb9c905bc01e777a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:00.161782 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:00.162690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:00.165251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1322/2635] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:19:59 2022] DELETE /identity/v3/projects/e4968554bf8b46eb9c905bc01e777a6d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:00.172451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13522012-f95f-4ab5-b704-3d452f9d9fe1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:00.172757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13522012-f95f-4ab5-b704-3d452f9d9fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:00.173703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13522012-f95f-4ab5-b704-3d452f9d9fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:00.220247 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-13522012-f95f-4ab5-b704-3d452f9d9fe1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:00.222244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-13522012-f95f-4ab5-b704-3d452f9d9fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:00.245973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:00.254930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:00.334404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1314/2636] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:20:00.343535 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d718-feaa-445d-bd87-f740b7ecaf8b None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:00.344452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d718-feaa-445d-bd87-f740b7ecaf8b None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:00.344929 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56d718-feaa-445d-bd87-f740b7ecaf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:00.379401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-aa56d718-feaa-445d-bd87-f740b7ecaf8b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:00.381085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-aa56d718-feaa-445d-bd87-f740b7ecaf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:00.396652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1315/2637] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:20:00.409077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56d718-feaa-445d-bd87-f740b7ecaf8b None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:00.414165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58336a-368e-43f0-b4aa-ec9398756350 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:00.422068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:00.423934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:00.424670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:00.426788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] PATH_INFO: `/v3/users/70022dac5bba48c1b71ad23d269003c9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:00.429293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70022dac5bba48c1b71ad23d269003c9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:00.433915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:00.445372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56d718-feaa-445d-bd87-f740b7ecaf8b None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:00.454308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:00.455213 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:00.455679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:00.455992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:00.457938 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:20:00.458393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:00.461878 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:00.491219 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1316/2638] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:20:00.493639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:00.497886 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:00.528298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36dcc2-d0e3-4978-abe9-dafc44b9d4f1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:00.535446 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:00.536633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:00.537552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:00.538251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] PATH_INFO: `/v3/projects/bc484c313f4e4b518f916617786b9a5e` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:00.539845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc484c313f4e4b518f916617786b9a5e)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:00.541874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:00.588320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:00.950263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc484c313f4e4b518f916617786b9a5e', 'request_id': 'req-10f58dd2-c02a-4230-a788-8414bf281531'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:00.953432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70022dac5bba48c1b71ad23d269003c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:00.954354 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70022dac5bba48c1b71ad23d269003c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:01.266343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc484c313f4e4b518f916617786b9a5e', 'request_id': 'req-10f58dd2-c02a-4230-a788-8414bf281531'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:01.283318 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc484c313f4e4b518f916617786b9a5e', 'request_id': 'req-10f58dd2-c02a-4230-a788-8414bf281531'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:01.311477 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] The token cache is being invalidate because project bc484c313f4e4b518f916617786b9a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:01.311901 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:01.312873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:01.324644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1317/2639] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:00 2022] DELETE /identity/v3/projects/bc484c313f4e4b518f916617786b9a5e => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:01.325970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:01.327676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:01.382464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70022dac5bba48c1b71ad23d269003c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:01.383355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70022dac5bba48c1b71ad23d269003c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:01.405845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-81c7d4cf-7215-42d3-a963-02bf1e28316f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70022dac5bba48c1b71ad23d269003c9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:01.422370 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58dd2-c02a-4230-a788-8414bf281531 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:01.431280 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1323/2640] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:00 2022] DELETE /identity/v3/users/70022dac5bba48c1b71ad23d269003c9 => generated 0 bytes in 1186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:01.434349 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595379-047b-4699-b36b-2e8b63ffa3db None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:01.435160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595379-047b-4699-b36b-2e8b63ffa3db None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:01.435679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc595379-047b-4699-b36b-2e8b63ffa3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:01.441786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda521-c911-4053-9c24-f2ed55599df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:01.442783 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda521-c911-4053-9c24-f2ed55599df1 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:01.443209 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda521-c911-4053-9c24-f2ed55599df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:01.443894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda521-c911-4053-9c24-f2ed55599df1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:01.445068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dda521-c911-4053-9c24-f2ed55599df1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:01.448679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dda521-c911-4053-9c24-f2ed55599df1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:01.478506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-fc595379-047b-4699-b36b-2e8b63ffa3db None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:01.482506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fc595379-047b-4699-b36b-2e8b63ffa3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:01.598652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1324/2641] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:01.600472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04421f1-8e4c-4330-805e-56c74a11129f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:01.600705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04421f1-8e4c-4330-805e-56c74a11129f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:01.601154 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04421f1-8e4c-4330-805e-56c74a11129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:01.629606 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1318/2642] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:01 2022] POST /identity/v3/projects => generated 387 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:01.630913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda521-c911-4053-9c24-f2ed55599df1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:01.646175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b04421f1-8e4c-4330-805e-56c74a11129f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:01.648142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b04421f1-8e4c-4330-805e-56c74a11129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:01.701096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:01.759757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda521-c911-4053-9c24-f2ed55599df1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:01.770694 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d192b3-3b0a-44a7-b041-4185f78f0fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:01.772864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d192b3-3b0a-44a7-b041-4185f78f0fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:01.773171 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d192b3-3b0a-44a7-b041-4185f78f0fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:01.773639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d192b3-3b0a-44a7-b041-4185f78f0fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:01.774338 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d192b3-3b0a-44a7-b041-4185f78f0fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:01.777990 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d192b3-3b0a-44a7-b041-4185f78f0fe8 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:01.809113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1325/2643] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:01.809113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362c21-61a5-4591-a70b-be3c4618f127 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:01.809113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362c21-61a5-4591-a70b-be3c4618f127 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:01.809464 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4362c21-61a5-4591-a70b-be3c4618f127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:01.885324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-b4362c21-61a5-4591-a70b-be3c4618f127 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:01.888140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b4362c21-61a5-4591-a70b-be3c4618f127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:01.919251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1326/2644] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:01.922073 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362c21-61a5-4591-a70b-be3c4618f127 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:01.925828 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-b4362c21-61a5-4591-a70b-be3c4618f127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:01.961765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1319/2645] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:01 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:01.961765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d192b3-3b0a-44a7-b041-4185f78f0fe8 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:01.983467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d192b3-3b0a-44a7-b041-4185f78f0fe8 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:02.004883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:02.005843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.006343 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.006810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.007704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:20:02.008238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:02.010973 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:02.049527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1320/2646] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:20:02.049527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:02.063049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4dc89-629c-4c11-bf1a-8f755fe5455d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:02.079242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:02.081662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.081662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.081662 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.085575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:02.093274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:02.093562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4362c21-61a5-4591-a70b-be3c4618f127 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:02.101996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567c25-b993-441e-9bb8-e66b8d506c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:02.103795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567c25-b993-441e-9bb8-e66b8d506c00 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.104036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567c25-b993-441e-9bb8-e66b8d506c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.104411 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28567c25-b993-441e-9bb8-e66b8d506c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.112049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1321/2647] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:02.117068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:02.119564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:02.121647 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28567c25-b993-441e-9bb8-e66b8d506c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:02.123225 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28567c25-b993-441e-9bb8-e66b8d506c00 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:02.134411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5a97c-2fac-44ca-bc02-0a57349e8ec2 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:02.143074 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1327/2648] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:02.144848 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567c25-b993-441e-9bb8-e66b8d506c00 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:02.158268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28567c25-b993-441e-9bb8-e66b8d506c00 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:02.162284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:02.163328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.165206 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.167008 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] PATH_INFO: `/v3/users/91dec5d881064e658beec2067a4d26eb` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.167171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db3d55-9fe0-4037-9621-1d42bc904868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:02.168165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3d55-9fe0-4037-9621-1d42bc904868 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.168527 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3d55-9fe0-4037-9621-1d42bc904868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.168886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db3d55-9fe0-4037-9621-1d42bc904868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.170436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db3d55-9fe0-4037-9621-1d42bc904868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:02.172181 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] RBAC: Authorizing `identity:delete_user(user_id=91dec5d881064e658beec2067a4d26eb)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:02.172665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db3d55-9fe0-4037-9621-1d42bc904868 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:02.179699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:02.347487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1328/2649] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:02 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:02.348438 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db3d55-9fe0-4037-9621-1d42bc904868 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:02.437628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91dec5d881064e658beec2067a4d26eb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:02.520260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91dec5d881064e658beec2067a4d26eb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:02.521260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91dec5d881064e658beec2067a4d26eb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:02.522634 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db3d55-9fe0-4037-9621-1d42bc904868 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:02.529705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:02.530881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.531416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.531955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.532839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:02.535455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:02.546517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91dec5d881064e658beec2067a4d26eb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:02.550818 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:02.555125 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91dec5d881064e658beec2067a4d26eb'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:02.558282 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1329/2650] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:02.559798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:02.565055 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:02.584553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1322/2651] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:02 2022] DELETE /identity/v3/users/91dec5d881064e658beec2067a4d26eb => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:02.589569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:02.592375 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:02.597480 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128b217-1653-4120-b0ff-1f647c1ee977 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:02.766523 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcc96a-34e9-4b89-a32e-120aeea2868c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:02.773512 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b031a80-e45c-4136-9182-aff3901a3a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:02.774259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:02.774793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031a80-e45c-4136-9182-aff3901a3a9f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.775010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.775497 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031a80-e45c-4136-9182-aff3901a3a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.775844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.776162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] PATH_INFO: `/v3/projects/89d7ee269f45454282c5c3b511884f73/users/c99da86304074a05812977f902ae4826/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.776587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b031a80-e45c-4136-9182-aff3901a3a9f admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.777466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031a80-e45c-4136-9182-aff3901a3a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:02.779763 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b031a80-e45c-4136-9182-aff3901a3a9f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:02.814590 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d7ee269f45454282c5c3b511884f73, user_id=c99da86304074a05812977f902ae4826, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:02.818494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:02.876561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1330/2652] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:02 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:02.880492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115d48-5136-4222-bfee-0c94d10b5f76 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:02.881036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115d48-5136-4222-bfee-0c94d10b5f76 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:02.881606 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f115d48-5136-4222-bfee-0c94d10b5f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:02.906927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1323/2653] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:02 2022] PUT /identity/v3/projects/89d7ee269f45454282c5c3b511884f73/users/c99da86304074a05812977f902ae4826/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:02.920371 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:02.928463 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:02.945586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-5f115d48-5136-4222-bfee-0c94d10b5f76 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:02.948218 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-5f115d48-5136-4222-bfee-0c94d10b5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:03.052211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:03.070081 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1331/2654] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:03.070998 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f115d48-5136-4222-bfee-0c94d10b5f76 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:03.111700 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f115d48-5136-4222-bfee-0c94d10b5f76 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:03.122430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217c827-d9df-48e3-9ab8-0ae050f063eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:03.123157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c827-d9df-48e3-9ab8-0ae050f063eb admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:03.124311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c827-d9df-48e3-9ab8-0ae050f063eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:03.124311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c827-d9df-48e3-9ab8-0ae050f063eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:03.125114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217c827-d9df-48e3-9ab8-0ae050f063eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:03.129697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217c827-d9df-48e3-9ab8-0ae050f063eb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:03.131628 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891a59d-2da4-4397-954a-25ddefe45bd9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:03.139857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:03.140520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:03.141372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:03.141372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] PATH_INFO: `/v3/projects/5db737d9186741468e9677a66d75743d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:03.142352 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db737d9186741468e9677a66d75743d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:03.148059 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:03.156632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1332/2655] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:03.158991 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f978b-ac5f-4cd6-b0d2-7ad78f5ee07d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:03.166597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f978b-ac5f-4cd6-b0d2-7ad78f5ee07d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:03.166597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f978b-ac5f-4cd6-b0d2-7ad78f5ee07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:03.221326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-309f978b-ac5f-4cd6-b0d2-7ad78f5ee07d None None] MFA Rules not processed for user `c99da86304074a05812977f902ae4826`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:03.223638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-309f978b-ac5f-4cd6-b0d2-7ad78f5ee07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:03.313025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db737d9186741468e9677a66d75743d', 'request_id': 'req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:03.332826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1333/2656] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:03.333776 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f978b-ac5f-4cd6-b0d2-7ad78f5ee07d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:03.335424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-309f978b-ac5f-4cd6-b0d2-7ad78f5ee07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:03.376711 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db737d9186741468e9677a66d75743d', 'request_id': 'req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:03.386651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db737d9186741468e9677a66d75743d', 'request_id': 'req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:03.421085 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] The token cache is being invalidate because project 5db737d9186741468e9677a66d75743d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:03.435970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:03.435970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:03.435970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1324/2657] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:02 2022] DELETE /identity/v3/projects/5db737d9186741468e9677a66d75743d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:03.435970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:03.435970 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:03.471292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f978b-ac5f-4cd6-b0d2-7ad78f5ee07d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:03.559506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a2a2-08a0-4ca3-a2ec-e44c34777c92 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:03.572988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:03.574265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:03.574265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:03.574265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:03.574841 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:03.576644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:03.613462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:03.613462 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:03.613830 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1325/2658] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:03.613918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:03.613918 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:03.614080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:03.618227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:03.618427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:03.632339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:03.632683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924e2b3-6f64-46a4-95e7-460cb497e246 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:03.634077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:03.641404 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206d1b7-a395-41f9-8b91-0462cdaff128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:03.648189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206d1b7-a395-41f9-8b91-0462cdaff128 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:03.648189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206d1b7-a395-41f9-8b91-0462cdaff128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:03.648189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206d1b7-a395-41f9-8b91-0462cdaff128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:03.648189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206d1b7-a395-41f9-8b91-0462cdaff128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:03.648601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1334/2659] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:03.648601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:03.648601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:03.653376 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206d1b7-a395-41f9-8b91-0462cdaff128 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:03.660078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88d011-06ce-4dce-a0a3-2dc2c770bf3c service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:03.665326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:03.666292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:03.666583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:03.666874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] PATH_INFO: `/v3/users/5f07c3cedbb2475192df0a304f802f69` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:03.668322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f07c3cedbb2475192df0a304f802f69)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:03.674520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:03.708684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:03.774981 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1326/2660] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:03 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:03.776978 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206d1b7-a395-41f9-8b91-0462cdaff128 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:03.888258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:03.903852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f07c3cedbb2475192df0a304f802f69'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:03.904740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f07c3cedbb2475192df0a304f802f69'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:03.940582 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206d1b7-a395-41f9-8b91-0462cdaff128 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:03.950114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:03.952044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:03.952412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:03.953639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] PATH_INFO: `/v3/projects/70dc3e2c991f4f0b81e3c5dbb3601448/users/62c00554e5f64843a54c6ab5b04e5238/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:03.997958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f07c3cedbb2475192df0a304f802f69'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.000079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f07c3cedbb2475192df0a304f802f69'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.010335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70dc3e2c991f4f0b81e3c5dbb3601448, user_id=62c00554e5f64843a54c6ab5b04e5238, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:04.027180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:04.035437 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f07c3cedbb2475192df0a304f802f69'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.062852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1335/2661] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:03 2022] DELETE /identity/v3/users/5f07c3cedbb2475192df0a304f802f69 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:04.063914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:04.067072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:04.115624 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1327/2662] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:03 2022] PUT /identity/v3/projects/70dc3e2c991f4f0b81e3c5dbb3601448/users/62c00554e5f64843a54c6ab5b04e5238/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:04.121143 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:04.124099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:04.151793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5933d-7960-437f-9732-a91afc0e28a5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:04.244646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93527e-16f6-466d-8fc9-88ec071366ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:04.247132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93527e-16f6-466d-8fc9-88ec071366ec admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:04.247668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93527e-16f6-466d-8fc9-88ec071366ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:04.248587 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93527e-16f6-466d-8fc9-88ec071366ec admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:04.249547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93527e-16f6-466d-8fc9-88ec071366ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:04.252451 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93527e-16f6-466d-8fc9-88ec071366ec admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:04.261618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0c0e4-ef85-44e7-adce-c9567f2a8573 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:04.269779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:04.270811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:04.281792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:04.281792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] PATH_INFO: `/v3/users/17f0ebe41e9b4ea8bfa8ebd07eb27539` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:04.281792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f0ebe41e9b4ea8bfa8ebd07eb27539)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:04.281792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:04.420414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1336/2663] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:04 2022] POST /identity/v3/users => generated 299 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:04.420414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81a26-f7e5-45bf-a73a-d62f3c61a341 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:04.420414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81a26-f7e5-45bf-a73a-d62f3c61a341 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:04.420414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d81a26-f7e5-45bf-a73a-d62f3c61a341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:04.465315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f5d81a26-f7e5-45bf-a73a-d62f3c61a341 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:04.466753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f5d81a26-f7e5-45bf-a73a-d62f3c61a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:04.477157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1337/2664] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:04.478195 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d81a26-f7e5-45bf-a73a-d62f3c61a341 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:04.482072 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f5d81a26-f7e5-45bf-a73a-d62f3c61a341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:04.496789 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d81a26-f7e5-45bf-a73a-d62f3c61a341 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:04.505142 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:04.505891 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:04.506308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:04.506686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] PATH_INFO: `/v3/projects/26c7606500fe406197ac6d61a943c5f2` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:04.507956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c7606500fe406197ac6d61a943c5f2)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:04.510234 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:04.589513 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f0ebe41e9b4ea8bfa8ebd07eb27539'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.599806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:04.669462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f0ebe41e9b4ea8bfa8ebd07eb27539'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.670042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f0ebe41e9b4ea8bfa8ebd07eb27539'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.684797 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c7606500fe406197ac6d61a943c5f2', 'request_id': 'req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.707543 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f0ebe41e9b4ea8bfa8ebd07eb27539'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.708205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f0ebe41e9b4ea8bfa8ebd07eb27539'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.728233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1328/2665] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:04 2022] DELETE /identity/v3/users/17f0ebe41e9b4ea8bfa8ebd07eb27539 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:04.740047 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:04.744510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:04.761768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c7606500fe406197ac6d61a943c5f2', 'request_id': 'req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.774489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c7606500fe406197ac6d61a943c5f2', 'request_id': 'req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.811608 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] The token cache is being invalidate because project 26c7606500fe406197ac6d61a943c5f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:04.812063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.814500 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:04.818539 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1338/2666] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:04 2022] DELETE /identity/v3/projects/26c7606500fe406197ac6d61a943c5f2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:04.819385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:04.823013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:04.881514 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aec30-9f54-4091-b1d8-bbb93e534d3c admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:04.893240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ace138-c64e-4941-9c1f-02ccfb6081f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:04.894048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace138-c64e-4941-9c1f-02ccfb6081f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:04.895432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace138-c64e-4941-9c1f-02ccfb6081f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:04.895956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ace138-c64e-4941-9c1f-02ccfb6081f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:04.897215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ace138-c64e-4941-9c1f-02ccfb6081f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:04.901639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ace138-c64e-4941-9c1f-02ccfb6081f5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:04.919287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1329/2667] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:04.920854 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10463b-7bdc-41b5-acd7-2a2838d4cde5 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:04.921151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10463b-7bdc-41b5-acd7-2a2838d4cde5 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:04.921506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10463b-7bdc-41b5-acd7-2a2838d4cde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:04.940750 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ecc96-4f81-48ff-a3e4-e0c101eb7cfe admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:04.953456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1e10463b-7bdc-41b5-acd7-2a2838d4cde5 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:04.954753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1e10463b-7bdc-41b5-acd7-2a2838d4cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:04.965334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:04.973811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1330/2668] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:04.974140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10463b-7bdc-41b5-acd7-2a2838d4cde5 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:04.975740 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1e10463b-7bdc-41b5-acd7-2a2838d4cde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:04.993127 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10463b-7bdc-41b5-acd7-2a2838d4cde5 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:05.007013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.008517 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.009099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.009578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] PATH_INFO: `/v3/projects/4908ad5e621547348bfba79774f19400` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.011588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4908ad5e621547348bfba79774f19400)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.013785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:05.027929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da098ad-25a3-4c47-96ec-679ccb721aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.028727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da098ad-25a3-4c47-96ec-679ccb721aed service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.028937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da098ad-25a3-4c47-96ec-679ccb721aed service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.029301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da098ad-25a3-4c47-96ec-679ccb721aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.032122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3da098ad-25a3-4c47-96ec-679ccb721aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:05.049395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da098ad-25a3-4c47-96ec-679ccb721aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.052888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da098ad-25a3-4c47-96ec-679ccb721aed service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:05.066384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1339/2669] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:05.067840 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf248-529d-48f3-bbb3-cced146cd3e4 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.072475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf248-529d-48f3-bbb3-cced146cd3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.072475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf248-529d-48f3-bbb3-cced146cd3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.095251 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3f8bf248-529d-48f3-bbb3-cced146cd3e4 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:05.098383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3f8bf248-529d-48f3-bbb3-cced146cd3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:05.117781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1340/2670] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:05.117781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bf248-529d-48f3-bbb3-cced146cd3e4 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:05.117781 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3f8bf248-529d-48f3-bbb3-cced146cd3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:05.125777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bf248-529d-48f3-bbb3-cced146cd3e4 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:05.149392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4908ad5e621547348bfba79774f19400', 'request_id': 'req-bf3a8c4d-e511-4e24-9f5a-7617044a6842'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:05.204770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4908ad5e621547348bfba79774f19400', 'request_id': 'req-bf3a8c4d-e511-4e24-9f5a-7617044a6842'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:05.217594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4908ad5e621547348bfba79774f19400', 'request_id': 'req-bf3a8c4d-e511-4e24-9f5a-7617044a6842'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:05.252378 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] The token cache is being invalidate because project 4908ad5e621547348bfba79774f19400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:05.252763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:05.255670 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:05.258215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1331/2671] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:04 2022] DELETE /identity/v3/projects/4908ad5e621547348bfba79774f19400 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:05.259214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:05.261668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:05.268961 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.271196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.271196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.271196 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] PATH_INFO: `/v3/projects/a1514714ba014da19551c044b02edf7a/users/4226d8d250be4adab2a3b125a5348ce4/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.316677 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1514714ba014da19551c044b02edf7a, user_id=4226d8d250be4adab2a3b125a5348ce4, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.323233 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:05.387326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a8c4d-e511-4e24-9f5a-7617044a6842 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:05.397436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b0f2e-b374-4854-9336-70b261aa882a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.397436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0f2e-b374-4854-9336-70b261aa882a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.397436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0f2e-b374-4854-9336-70b261aa882a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.397436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b0f2e-b374-4854-9336-70b261aa882a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.398221 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-622b0f2e-b374-4854-9336-70b261aa882a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:05.416494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b0f2e-b374-4854-9336-70b261aa882a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.419913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b0f2e-b374-4854-9336-70b261aa882a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:05.437298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1332/2672] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:05.442418 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229739f-32a1-4ade-83e7-040a07a8a69a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.443076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229739f-32a1-4ade-83e7-040a07a8a69a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.443705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229739f-32a1-4ade-83e7-040a07a8a69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.445403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1341/2673] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:05 2022] PUT /identity/v3/projects/a1514714ba014da19551c044b02edf7a/users/4226d8d250be4adab2a3b125a5348ce4/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:05.450350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:05.467151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:05.480892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3229739f-32a1-4ade-83e7-040a07a8a69a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:05.482713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3229739f-32a1-4ade-83e7-040a07a8a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:05.578165 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1333/2674] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:05.579159 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229739f-32a1-4ade-83e7-040a07a8a69a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:05.581424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3229739f-32a1-4ade-83e7-040a07a8a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:05.595433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9477e-b0a8-47a5-898f-50b8215e7fcc admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:05.596818 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229739f-32a1-4ade-83e7-040a07a8a69a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:05.605326 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871082b-5893-42c5-ae4b-261289716f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.606123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:05.606900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871082b-5893-42c5-ae4b-261289716f85 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.607604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871082b-5893-42c5-ae4b-261289716f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.607932 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871082b-5893-42c5-ae4b-261289716f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.609297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871082b-5893-42c5-ae4b-261289716f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.611962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871082b-5893-42c5-ae4b-261289716f85 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:05.613115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.613804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.614085 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.614404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] PATH_INFO: `/v3/users/30f8b8a4a0e841f9b2c5464a719faf5f` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.618752 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f8b8a4a0e841f9b2c5464a719faf5f)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.620902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:05.642398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1334/2675] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:05.646061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871082b-5893-42c5-ae4b-261289716f85 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:05.678289 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871082b-5893-42c5-ae4b-261289716f85 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:05.690006 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.692113 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.692432 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.693203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.694334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:20:05.694982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.695098 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:05.698095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:05.720806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1335/2676] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:20:05.722745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:05.738827 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4add08-077b-4ecd-8bd1-deb613b518f9 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:05.755345 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32875-85ab-4cdf-863f-a5f295d10155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.756136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32875-85ab-4cdf-863f-a5f295d10155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.756895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32875-85ab-4cdf-863f-a5f295d10155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.756895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b32875-85ab-4cdf-863f-a5f295d10155 admin admin] PATH_INFO: `/v3/projects/a1514714ba014da19551c044b02edf7a/users/4226d8d250be4adab2a3b125a5348ce4/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.760665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b32875-85ab-4cdf-863f-a5f295d10155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1514714ba014da19551c044b02edf7a, user_id=4226d8d250be4adab2a3b125a5348ce4, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.763640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b32875-85ab-4cdf-863f-a5f295d10155 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:05.782681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1336/2677] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:05 2022] PUT /identity/v3/projects/a1514714ba014da19551c044b02edf7a/users/4226d8d250be4adab2a3b125a5348ce4/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:05.788880 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32875-85ab-4cdf-863f-a5f295d10155 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:05.911823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b32875-85ab-4cdf-863f-a5f295d10155 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:05.921049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:05.921368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f8b8a4a0e841f9b2c5464a719faf5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:05.921987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:05.922179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f8b8a4a0e841f9b2c5464a719faf5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:05.922986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:05.923363 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:05.924359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:05.928652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:06.022138 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f8b8a4a0e841f9b2c5464a719faf5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:06.023134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f8b8a4a0e841f9b2c5464a719faf5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:06.055262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:06.060796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2a6eeed0-659d-4613-a406-ae4db29123d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f8b8a4a0e841f9b2c5464a719faf5f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:06.098958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1342/2678] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:05 2022] DELETE /identity/v3/users/30f8b8a4a0e841f9b2c5464a719faf5f => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:06.099175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1337/2679] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:05 2022] POST /identity/v3/projects => generated 375 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:06.099299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266be66-fe5d-4d9c-9348-bfecb466d0bc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:06.099299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266be66-fe5d-4d9c-9348-bfecb466d0bc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:06.099482 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266be66-fe5d-4d9c-9348-bfecb466d0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:06.106882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:06.110162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:06.164832 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-e266be66-fe5d-4d9c-9348-bfecb466d0bc None None] MFA Rules not processed for user `4226d8d250be4adab2a3b125a5348ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:06.170221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e266be66-fe5d-4d9c-9348-bfecb466d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:06.343155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ffc56-b767-490c-87a1-c5011d3a74af admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:06.418033 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1343/2680] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:06.437385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266be66-fe5d-4d9c-9348-bfecb466d0bc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:06.439194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e266be66-fe5d-4d9c-9348-bfecb466d0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:06.497308 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:06.498040 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:06.498306 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:06.498536 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:06.499203 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:06.501275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:06.586698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:06.590709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266be66-fe5d-4d9c-9348-bfecb466d0bc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:06.601994 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba457e5-03f2-4010-88ff-888f0bd6c96a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:06.603210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba457e5-03f2-4010-88ff-888f0bd6c96a service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:06.603762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba457e5-03f2-4010-88ff-888f0bd6c96a service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:06.604216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba457e5-03f2-4010-88ff-888f0bd6c96a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:06.618297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1338/2681] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:06 2022] POST /identity/v3/users => generated 288 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:06.619038 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:06.627777 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:06.639047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba457e5-03f2-4010-88ff-888f0bd6c96a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:06.641960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba457e5-03f2-4010-88ff-888f0bd6c96a service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:06.658361 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05350f2-cf8d-47f3-ac7b-b2ae105bc8cb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:06.664599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:06.665249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:06.665532 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:06.665811 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] PATH_INFO: `/v3/projects/025380b96f704c8c83345078150d25cb` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:06.667082 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=025380b96f704c8c83345078150d25cb)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:06.675792 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:06.707156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1344/2682] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:06.710845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba457e5-03f2-4010-88ff-888f0bd6c96a service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:06.792346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba457e5-03f2-4010-88ff-888f0bd6c96a service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:06.817086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:06.821672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:06.822274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:06.822822 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:06.825442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:06.843170 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:06.853996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:06.880047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1345/2683] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:06.883770 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:06.887915 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:06.916169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15416d6e-c167-44e6-9a07-beeff26050f5 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:06.930976 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:06.931643 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:06.931953 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:06.932236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] PATH_INFO: `/v3/users/c99da86304074a05812977f902ae4826` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:06.933520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99da86304074a05812977f902ae4826)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:06.935966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:07.010150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025380b96f704c8c83345078150d25cb', 'request_id': 'req-164884a9-3c75-460a-9925-956e04ad72d6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.117069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025380b96f704c8c83345078150d25cb', 'request_id': 'req-164884a9-3c75-460a-9925-956e04ad72d6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.136449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025380b96f704c8c83345078150d25cb', 'request_id': 'req-164884a9-3c75-460a-9925-956e04ad72d6'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.154645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] The token cache is being invalidate because project 025380b96f704c8c83345078150d25cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:07.154645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.155257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.157480 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1339/2684] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:06 2022] DELETE /identity/v3/projects/025380b96f704c8c83345078150d25cb => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:07.158314 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:07.161438 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:07.254909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99da86304074a05812977f902ae4826'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.256348 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99da86304074a05812977f902ae4826'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.350161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99da86304074a05812977f902ae4826'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.353542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99da86304074a05812977f902ae4826'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.379626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99da86304074a05812977f902ae4826'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.403527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164884a9-3c75-460a-9925-956e04ad72d6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:07.404509 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1346/2685] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:06 2022] DELETE /identity/v3/users/c99da86304074a05812977f902ae4826 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:07.410039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:07.417075 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:07.515323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd715f-df01-40ff-9ce0-cd274611483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:07.516286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd715f-df01-40ff-9ce0-cd274611483e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:07.516286 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd715f-df01-40ff-9ce0-cd274611483e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:07.516643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd715f-df01-40ff-9ce0-cd274611483e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:07.517307 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd715f-df01-40ff-9ce0-cd274611483e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:07.525150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd715f-df01-40ff-9ce0-cd274611483e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:07.525759 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e3df0-36ee-45cc-9bc3-1d7dd4b32466 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:07.537567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:07.537567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:07.537567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:07.537567 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] PATH_INFO: `/v3/projects/eb23ca89b7ad4e4592cce7422d03bae9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:07.538335 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb23ca89b7ad4e4592cce7422d03bae9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:07.542231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:07.546356 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1340/2686] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:07.551791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9202f44-cf00-483d-80af-d47797203200 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:07.551791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9202f44-cf00-483d-80af-d47797203200 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:07.551791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9202f44-cf00-483d-80af-d47797203200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:07.576893 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-a9202f44-cf00-483d-80af-d47797203200 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:07.578526 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a9202f44-cf00-483d-80af-d47797203200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:07.592515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1341/2687] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:07.593979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9202f44-cf00-483d-80af-d47797203200 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:07.596304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-a9202f44-cf00-483d-80af-d47797203200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:07.617177 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9202f44-cf00-483d-80af-d47797203200 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:07.630268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:07.630618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:07.630618 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:07.630912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] PATH_INFO: `/v3/projects/03595080e1784ea8bd9bfa6c9652e8bd/users/45937fdd894e42b0ba333c72ce352712/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:07.656436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03595080e1784ea8bd9bfa6c9652e8bd, user_id=45937fdd894e42b0ba333c72ce352712, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:07.664291 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:07.813009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1342/2688] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:07 2022] PUT /identity/v3/projects/03595080e1784ea8bd9bfa6c9652e8bd/users/45937fdd894e42b0ba333c72ce352712/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:07.814067 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:07.834355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:07.843886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb23ca89b7ad4e4592cce7422d03bae9', 'request_id': 'req-891cbff2-1912-447a-9a85-ee7f058f94de'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.931871 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb23ca89b7ad4e4592cce7422d03bae9', 'request_id': 'req-891cbff2-1912-447a-9a85-ee7f058f94de'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.943239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb23ca89b7ad4e4592cce7422d03bae9', 'request_id': 'req-891cbff2-1912-447a-9a85-ee7f058f94de'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.992584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] The token cache is being invalidate because project eb23ca89b7ad4e4592cce7422d03bae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:07.992584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:07.994916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-891cbff2-1912-447a-9a85-ee7f058f94de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:08.013625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1347/2689] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:07 2022] DELETE /identity/v3/projects/eb23ca89b7ad4e4592cce7422d03bae9 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:08.015262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b645d-449f-44d0-89ab-48d841214a63 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:08.032275 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b645d-449f-44d0-89ab-48d841214a63 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:08.032599 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b645d-449f-44d0-89ab-48d841214a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:08.045593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:08.108993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b339cb2-5564-492a-8b73-b0327d6f9621 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:08.194414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-263b645d-449f-44d0-89ab-48d841214a63 None None] MFA Rules not processed for user `45937fdd894e42b0ba333c72ce352712`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:08.197440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-263b645d-449f-44d0-89ab-48d841214a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:08.278715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:08.322972 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:08.323801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:08.324499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:08.325462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:08.329003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:08.384903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1348/2690] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:08.386956 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b645d-449f-44d0-89ab-48d841214a63 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:08.389062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-263b645d-449f-44d0-89ab-48d841214a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:08.563558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b645d-449f-44d0-89ab-48d841214a63 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:08.581801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4c566-b3d1-46be-9102-95280c6e8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:08.581801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4c566-b3d1-46be-9102-95280c6e8f7d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:08.581801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4c566-b3d1-46be-9102-95280c6e8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:08.581801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c4c566-b3d1-46be-9102-95280c6e8f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:08.582284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4c566-b3d1-46be-9102-95280c6e8f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:08.582284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c4c566-b3d1-46be-9102-95280c6e8f7d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:08.638146 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:08.641495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:08.662417 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1343/2691] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 849 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:08.805022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1349/2692] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:08 2022] POST /identity/v3/projects => generated 373 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:20:08.810072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:08.823453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903082e-e19a-46df-85ad-9a692642b2e7 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:08.923214 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522104-9033-4812-b02f-ac2b0ee2b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:08.923974 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522104-9033-4812-b02f-ac2b0ee2b004 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:08.924282 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522104-9033-4812-b02f-ac2b0ee2b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:08.924588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd522104-9033-4812-b02f-ac2b0ee2b004 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:08.926180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522104-9033-4812-b02f-ac2b0ee2b004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:08.928230 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd522104-9033-4812-b02f-ac2b0ee2b004 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:09.021277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1344/2693] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:08 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:09.027391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4c566-b3d1-46be-9102-95280c6e8f7d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:09.052489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c4c566-b3d1-46be-9102-95280c6e8f7d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:09.070691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4834b-ed27-4acd-8e92-7e55183a2fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:09.071341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4834b-ed27-4acd-8e92-7e55183a2fde admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:09.071657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4834b-ed27-4acd-8e92-7e55183a2fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:09.072113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4834b-ed27-4acd-8e92-7e55183a2fde admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:09.073357 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4834b-ed27-4acd-8e92-7e55183a2fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:09.076568 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d4834b-ed27-4acd-8e92-7e55183a2fde admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:09.098698 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1350/2694] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:20:09.104538 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522104-9033-4812-b02f-ac2b0ee2b004 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:09.125233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd522104-9033-4812-b02f-ac2b0ee2b004 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:09.137985 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8c4aa-2f2a-422a-8945-9a8cfe8ff130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:09.138956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c4aa-2f2a-422a-8945-9a8cfe8ff130 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:09.139831 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c4aa-2f2a-422a-8945-9a8cfe8ff130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:09.140328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8c4aa-2f2a-422a-8945-9a8cfe8ff130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:09.141431 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8c4aa-2f2a-422a-8945-9a8cfe8ff130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:09.143568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8c4aa-2f2a-422a-8945-9a8cfe8ff130 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:09.164131 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1345/2695] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:09.170020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4834b-ed27-4acd-8e92-7e55183a2fde admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:09.188407 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d4834b-ed27-4acd-8e92-7e55183a2fde admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:09.195654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc140c-917a-462e-96c9-51eaed51b460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:09.197177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc140c-917a-462e-96c9-51eaed51b460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:09.197685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc140c-917a-462e-96c9-51eaed51b460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:09.198296 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc140c-917a-462e-96c9-51eaed51b460 admin admin] PATH_INFO: `/v3/projects/46ce630a445d46dca8a7a9a5e3fd92ad/users/0a0a87c2e35e4e49950087ee76bdf0b2/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:09.226436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc140c-917a-462e-96c9-51eaed51b460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ce630a445d46dca8a7a9a5e3fd92ad, user_id=0a0a87c2e35e4e49950087ee76bdf0b2, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:09.229883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc140c-917a-462e-96c9-51eaed51b460 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:09.329165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1351/2696] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:09 2022] PUT /identity/v3/projects/46ce630a445d46dca8a7a9a5e3fd92ad/users/0a0a87c2e35e4e49950087ee76bdf0b2/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:09.340440 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170101b7-c635-41df-beff-ecf64d58eb16 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:09.340703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170101b7-c635-41df-beff-ecf64d58eb16 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:09.341718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170101b7-c635-41df-beff-ecf64d58eb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:09.426009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-170101b7-c635-41df-beff-ecf64d58eb16 None None] MFA Rules not processed for user `0a0a87c2e35e4e49950087ee76bdf0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:09.427388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-170101b7-c635-41df-beff-ecf64d58eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:09.467528 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:09.613074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1346/2697] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:09.615637 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc140c-917a-462e-96c9-51eaed51b460 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:09.643801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170101b7-c635-41df-beff-ecf64d58eb16 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:09.647642 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-170101b7-c635-41df-beff-ecf64d58eb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:09.767581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:09.837767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc140c-917a-462e-96c9-51eaed51b460 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:09.876644 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf523c0e-cf53-4f76-a525-158b406be1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:09.877942 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523c0e-cf53-4f76-a525-158b406be1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:09.878148 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170101b7-c635-41df-beff-ecf64d58eb16 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:09.883231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523c0e-cf53-4f76-a525-158b406be1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:09.883596 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf523c0e-cf53-4f76-a525-158b406be1b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:09.884314 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf523c0e-cf53-4f76-a525-158b406be1b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:09.886329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf523c0e-cf53-4f76-a525-158b406be1b3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:09.886608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:09.887183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:09.887562 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:09.887927 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] PATH_INFO: `/v3/projects/89d7ee269f45454282c5c3b511884f73` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:09.894666 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d7ee269f45454282c5c3b511884f73)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:09.906044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:10.045293 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1352/2698] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:09 2022] POST /identity/v3/projects => generated 375 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:10.047429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf523c0e-cf53-4f76-a525-158b406be1b3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:10.075337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d7ee269f45454282c5c3b511884f73', 'request_id': 'req-d0ec593e-e6de-4826-a252-2c00080219ed'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.154081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d7ee269f45454282c5c3b511884f73', 'request_id': 'req-d0ec593e-e6de-4826-a252-2c00080219ed'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.161753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf523c0e-cf53-4f76-a525-158b406be1b3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:10.164288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d7ee269f45454282c5c3b511884f73', 'request_id': 'req-d0ec593e-e6de-4826-a252-2c00080219ed'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.169534 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:10.170324 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:10.170663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:10.171063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:10.172078 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:10.174815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:10.191604 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] The token cache is being invalidate because project 89d7ee269f45454282c5c3b511884f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:10.193581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.195398 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.197736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1347/2699] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:09 2022] DELETE /identity/v3/projects/89d7ee269f45454282c5c3b511884f73 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:10.203922 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:10.205626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:10.278473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1353/2700] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:10 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:10.283211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:10.290658 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:10.324791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ae4e2-37cc-4c5a-9547-355c387dc504 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:10.344486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58e7a-e3f7-498f-95fb-94404da2dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:10.348426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58e7a-e3f7-498f-95fb-94404da2dddd admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:10.348957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58e7a-e3f7-498f-95fb-94404da2dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:10.349805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc58e7a-e3f7-498f-95fb-94404da2dddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:10.352266 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58e7a-e3f7-498f-95fb-94404da2dddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:10.359879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc58e7a-e3f7-498f-95fb-94404da2dddd admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:10.363136 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec593e-e6de-4826-a252-2c00080219ed admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:10.371095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:10.371960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:10.372393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:10.372776 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] PATH_INFO: `/v3/users/4226d8d250be4adab2a3b125a5348ce4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:10.374280 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4226d8d250be4adab2a3b125a5348ce4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:10.379233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:10.403997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1354/2701] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:10.409938 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58e7a-e3f7-498f-95fb-94404da2dddd admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:10.443974 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc58e7a-e3f7-498f-95fb-94404da2dddd admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:10.457127 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaea0b-764d-415d-ba31-32344061749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:10.458056 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaea0b-764d-415d-ba31-32344061749f admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:10.458343 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaea0b-764d-415d-ba31-32344061749f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:10.458629 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaea0b-764d-415d-ba31-32344061749f admin admin] PATH_INFO: `/v3/projects/23fc360f9f1c40a194e35e639f8e6117/users/7b398aa58b744cb9be8dc6a3eecb47ae/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:10.508456 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaea0b-764d-415d-ba31-32344061749f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fc360f9f1c40a194e35e639f8e6117, user_id=7b398aa58b744cb9be8dc6a3eecb47ae, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:10.522659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaea0b-764d-415d-ba31-32344061749f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:10.600636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:10.622796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1355/2702] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:10 2022] PUT /identity/v3/projects/23fc360f9f1c40a194e35e639f8e6117/users/7b398aa58b744cb9be8dc6a3eecb47ae/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:10.641734 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaea0b-764d-415d-ba31-32344061749f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:10.736329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4226d8d250be4adab2a3b125a5348ce4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.816020 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaea0b-764d-415d-ba31-32344061749f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:10.823038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0140b02-c5fe-4c27-9edd-d524b18dd982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:10.823909 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0140b02-c5fe-4c27-9edd-d524b18dd982 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:10.824427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0140b02-c5fe-4c27-9edd-d524b18dd982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:10.824675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0140b02-c5fe-4c27-9edd-d524b18dd982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:10.825449 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0140b02-c5fe-4c27-9edd-d524b18dd982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:10.831215 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0140b02-c5fe-4c27-9edd-d524b18dd982 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:10.834240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4226d8d250be4adab2a3b125a5348ce4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.835864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4226d8d250be4adab2a3b125a5348ce4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.857103 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1356/2703] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:10.858290 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0140b02-c5fe-4c27-9edd-d524b18dd982 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:10.876931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0140b02-c5fe-4c27-9edd-d524b18dd982 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:10.883479 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163aba9-8a6f-4846-8e9d-aec29dedc99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:10.884441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163aba9-8a6f-4846-8e9d-aec29dedc99c admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:10.884611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4226d8d250be4adab2a3b125a5348ce4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.884923 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163aba9-8a6f-4846-8e9d-aec29dedc99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:10.885367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4226d8d250be4adab2a3b125a5348ce4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:10.885536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163aba9-8a6f-4846-8e9d-aec29dedc99c admin admin] PATH_INFO: `/v3/projects/23fc360f9f1c40a194e35e639f8e6117/users/7b398aa58b744cb9be8dc6a3eecb47ae/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:10.888097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163aba9-8a6f-4846-8e9d-aec29dedc99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fc360f9f1c40a194e35e639f8e6117, user_id=7b398aa58b744cb9be8dc6a3eecb47ae, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:10.894768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163aba9-8a6f-4846-8e9d-aec29dedc99c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:10.927764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1357/2704] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:10 2022] PUT /identity/v3/projects/23fc360f9f1c40a194e35e639f8e6117/users/7b398aa58b744cb9be8dc6a3eecb47ae/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:10.929504 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1348/2705] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:10 2022] DELETE /identity/v3/users/4226d8d250be4adab2a3b125a5348ce4 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:11.001207 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e87711-7ca2-4e18-b274-7b89ef2984c3 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:11.001661 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e87711-7ca2-4e18-b274-7b89ef2984c3 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:11.001947 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e87711-7ca2-4e18-b274-7b89ef2984c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:11.082738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-93e87711-7ca2-4e18-b274-7b89ef2984c3 None None] MFA Rules not processed for user `7b398aa58b744cb9be8dc6a3eecb47ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:11.088771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-93e87711-7ca2-4e18-b274-7b89ef2984c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:11.204272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:11.253741 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1358/2706] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:20:11.267275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:11.269631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:11.466178 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898f723-f39e-4254-a205-eaa047923cd7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:11.468693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:11.476187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de16d19-116c-4c05-aa30-4616d132394f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:11.476803 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16d19-116c-4c05-aa30-4616d132394f service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:11.477093 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16d19-116c-4c05-aa30-4616d132394f service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:11.477379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16d19-116c-4c05-aa30-4616d132394f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:11.495425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4de16d19-116c-4c05-aa30-4616d132394f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:11.690996 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de16d19-116c-4c05-aa30-4616d132394f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:11.695017 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de16d19-116c-4c05-aa30-4616d132394f service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:11.706952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1349/2707] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:11.771409 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e87711-7ca2-4e18-b274-7b89ef2984c3 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:11.772851 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-93e87711-7ca2-4e18-b274-7b89ef2984c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:11.956453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e87711-7ca2-4e18-b274-7b89ef2984c3 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:11.967099 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:11.968014 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:11.968503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:11.968788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] PATH_INFO: `/v3/projects/a1514714ba014da19551c044b02edf7a` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:11.970292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1514714ba014da19551c044b02edf7a)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:11.973800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:12.159972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1514714ba014da19551c044b02edf7a', 'request_id': 'req-07567d4a-7531-431d-8f53-ca3f16087524'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:12.273638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1514714ba014da19551c044b02edf7a', 'request_id': 'req-07567d4a-7531-431d-8f53-ca3f16087524'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:12.286622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1514714ba014da19551c044b02edf7a', 'request_id': 'req-07567d4a-7531-431d-8f53-ca3f16087524'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:12.318319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] The token cache is being invalidate because project a1514714ba014da19551c044b02edf7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:12.318815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:12.322444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-07567d4a-7531-431d-8f53-ca3f16087524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:12.325006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1359/2708] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:11 2022] DELETE /identity/v3/projects/a1514714ba014da19551c044b02edf7a => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:12.336205 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbaefc-0b95-401e-b9ff-34becd50d694 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:12.338003 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbaefc-0b95-401e-b9ff-34becd50d694 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:12.338473 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbaefc-0b95-401e-b9ff-34becd50d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:12.384227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-18cbaefc-0b95-401e-b9ff-34becd50d694 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:12.385632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-18cbaefc-0b95-401e-b9ff-34becd50d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:12.390780 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:12.533551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1350/2709] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:12.545229 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa023ba7-8df3-4bc3-aedf-64e9e07bebfd None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:12.545793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa023ba7-8df3-4bc3-aedf-64e9e07bebfd None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:12.546175 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa023ba7-8df3-4bc3-aedf-64e9e07bebfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:12.578088 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-aa023ba7-8df3-4bc3-aedf-64e9e07bebfd None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:12.579856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-aa023ba7-8df3-4bc3-aedf-64e9e07bebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:12.594365 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1360/2710] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:12.603678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbaefc-0b95-401e-b9ff-34becd50d694 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:12.636966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbaefc-0b95-401e-b9ff-34becd50d694 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:12.644847 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:12.645632 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:12.646594 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:12.646977 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:12.647806 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:20:12.648242 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:12.652572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:12.741401 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1351/2711] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:20:12.745593 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa023ba7-8df3-4bc3-aedf-64e9e07bebfd None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:12.773849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa023ba7-8df3-4bc3-aedf-64e9e07bebfd None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:12.796621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32435c8c-57e5-4664-83ef-d931b9ec4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:12.801937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32435c8c-57e5-4664-83ef-d931b9ec4920 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:12.801937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32435c8c-57e5-4664-83ef-d931b9ec4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:12.801937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32435c8c-57e5-4664-83ef-d931b9ec4920 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:12.801937 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32435c8c-57e5-4664-83ef-d931b9ec4920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:12.805905 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32435c8c-57e5-4664-83ef-d931b9ec4920 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:12.966342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1361/2712] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:12 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:12.970168 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:12.991639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83f43-445d-49cd-8846-f4549ee54ebb admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:13.130928 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb1b5-d06d-4d63-b263-86fdbb130b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:13.131675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb1b5-d06d-4d63-b263-86fdbb130b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:13.132257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb1b5-d06d-4d63-b263-86fdbb130b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:13.132608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceb1b5-d06d-4d63-b263-86fdbb130b1e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:13.133346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ceb1b5-d06d-4d63-b263-86fdbb130b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:13.135858 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ceb1b5-d06d-4d63-b263-86fdbb130b1e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:13.250591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1352/2713] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:12 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:20:13.255494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32435c8c-57e5-4664-83ef-d931b9ec4920 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:13.266973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32435c8c-57e5-4664-83ef-d931b9ec4920 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:13.270883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:13.275807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3806a-53f1-4d70-91c9-c3d1effc1f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:13.276805 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3806a-53f1-4d70-91c9-c3d1effc1f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:13.277272 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3806a-53f1-4d70-91c9-c3d1effc1f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:13.277775 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d3806a-53f1-4d70-91c9-c3d1effc1f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:13.278693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3806a-53f1-4d70-91c9-c3d1effc1f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:13.280679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d3806a-53f1-4d70-91c9-c3d1effc1f64 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:13.301590 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1362/2714] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:13.303399 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb1b5-d06d-4d63-b263-86fdbb130b1e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:13.322491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceb1b5-d06d-4d63-b263-86fdbb130b1e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:13.339877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971492a-7a12-4a08-99a7-7331bcf0c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:13.340625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971492a-7a12-4a08-99a7-7331bcf0c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:13.341061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971492a-7a12-4a08-99a7-7331bcf0c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:13.341581 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971492a-7a12-4a08-99a7-7331bcf0c3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:13.342714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971492a-7a12-4a08-99a7-7331bcf0c3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:13.346337 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971492a-7a12-4a08-99a7-7331bcf0c3d3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:13.390076 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1353/2715] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:13.393999 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3806a-53f1-4d70-91c9-c3d1effc1f64 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:13.413008 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d3806a-53f1-4d70-91c9-c3d1effc1f64 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:13.427440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed39f-ec08-4cc6-bac8-cf469afe37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:13.428268 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed39f-ec08-4cc6-bac8-cf469afe37ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:13.428605 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed39f-ec08-4cc6-bac8-cf469afe37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:13.428888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeed39f-ec08-4cc6-bac8-cf469afe37ab admin admin] PATH_INFO: `/v3/projects/a7ea5833000d4f31bf5924bb3d1dbc7b/users/35338daec9c84343af1481934b3bb4cf/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:13.473936 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeed39f-ec08-4cc6-bac8-cf469afe37ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ea5833000d4f31bf5924bb3d1dbc7b, user_id=35338daec9c84343af1481934b3bb4cf, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:13.480224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeed39f-ec08-4cc6-bac8-cf469afe37ab admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:13.601726 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:13.615197 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1363/2716] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:13 2022] PUT /identity/v3/projects/a7ea5833000d4f31bf5924bb3d1dbc7b/users/35338daec9c84343af1481934b3bb4cf/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:13.626652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b60d-3e4f-4037-95f9-88413357111a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:13.628898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b60d-3e4f-4037-95f9-88413357111a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:13.629560 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b60d-3e4f-4037-95f9-88413357111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:13.724692 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-11d6b60d-3e4f-4037-95f9-88413357111a None None] MFA Rules not processed for user `35338daec9c84343af1481934b3bb4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:13.726272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-11d6b60d-3e4f-4037-95f9-88413357111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:13.904005 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1354/2717] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:13.905478 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed39f-ec08-4cc6-bac8-cf469afe37ab admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:14.074326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeed39f-ec08-4cc6-bac8-cf469afe37ab admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:14.086761 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:14.088219 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:14.088821 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:14.090264 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:14.091146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:14.096069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:14.216909 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6b60d-3e4f-4037-95f9-88413357111a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:14.218626 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1364/2718] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:13 2022] POST /identity/v3/projects => generated 377 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:14.232939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6b60d-3e4f-4037-95f9-88413357111a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:14.384429 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:14.423080 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:14.427791 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:14.481788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:14.517448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fab6c-4afb-44df-8ab5-1e0e998fc2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:14.525591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fab6c-4afb-44df-8ab5-1e0e998fc2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:14.526897 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fab6c-4afb-44df-8ab5-1e0e998fc2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:14.527396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fab6c-4afb-44df-8ab5-1e0e998fc2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:14.532877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fab6c-4afb-44df-8ab5-1e0e998fc2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:14.537054 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fab6c-4afb-44df-8ab5-1e0e998fc2a3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:14.613269 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d34774-3ce4-4cde-b87d-c1ef8e290898 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:14.620117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:14.620785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:14.621082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:14.621569 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:14.625747 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:14.703785 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1355/2719] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:14 2022] POST /identity/v3/users => generated 289 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:20:14.709729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fab6c-4afb-44df-8ab5-1e0e998fc2a3 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:14.735032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fab6c-4afb-44df-8ab5-1e0e998fc2a3 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:14.755066 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797ef4f-c1c2-4c4e-aa90-f1798bb30a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:14.758470 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797ef4f-c1c2-4c4e-aa90-f1798bb30a2d admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:14.759848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797ef4f-c1c2-4c4e-aa90-f1798bb30a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:14.760900 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797ef4f-c1c2-4c4e-aa90-f1798bb30a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:14.762449 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797ef4f-c1c2-4c4e-aa90-f1798bb30a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:14.766869 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797ef4f-c1c2-4c4e-aa90-f1798bb30a2d admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:14.788941 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:14.790427 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:14.797873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1356/2720] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:14.809511 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797ef4f-c1c2-4c4e-aa90-f1798bb30a2d admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:14.820522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1365/2721] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:14.827520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797ef4f-c1c2-4c4e-aa90-f1798bb30a2d admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:14.836679 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7fd1c-71c8-4c83-b4f6-5dfbf3b74273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:14.837657 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7fd1c-71c8-4c83-b4f6-5dfbf3b74273 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:14.838254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7fd1c-71c8-4c83-b4f6-5dfbf3b74273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:14.838732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7fd1c-71c8-4c83-b4f6-5dfbf3b74273 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:14.839799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7fd1c-71c8-4c83-b4f6-5dfbf3b74273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:14.856123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7fd1c-71c8-4c83-b4f6-5dfbf3b74273 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:14.871660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1357/2722] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:14.882591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:14.915710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054edffa-6002-44ed-bfce-8acfc6f6389b service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:14.919422 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:14.946213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34989404-0c9e-479c-acd3-c4c802e2a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:14.946893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989404-0c9e-479c-acd3-c4c802e2a393 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:14.947199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989404-0c9e-479c-acd3-c4c802e2a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:14.947542 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989404-0c9e-479c-acd3-c4c802e2a393 admin admin] PATH_INFO: `/v3/projects/8bac0d37c6f146e7841a52e61e5de5f1/users/09279053506a4104b42e73f4d2e7ab5d/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:14.975957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:15.052966 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34989404-0c9e-479c-acd3-c4c802e2a393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bac0d37c6f146e7841a52e61e5de5f1, user_id=09279053506a4104b42e73f4d2e7ab5d, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:15.057346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34989404-0c9e-479c-acd3-c4c802e2a393 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:15.174970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1366/2723] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:14 2022] PUT /identity/v3/projects/8bac0d37c6f146e7841a52e61e5de5f1/users/09279053506a4104b42e73f4d2e7ab5d/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:15.191499 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37edab-4e53-44d5-b8cc-f7e7af89413f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:15.192004 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37edab-4e53-44d5-b8cc-f7e7af89413f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:15.192844 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37edab-4e53-44d5-b8cc-f7e7af89413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:15.205984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:15.276528 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3b37edab-4e53-44d5-b8cc-f7e7af89413f None None] MFA Rules not processed for user `09279053506a4104b42e73f4d2e7ab5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:15.279610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3b37edab-4e53-44d5-b8cc-f7e7af89413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:15.522155 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1358/2724] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:15.527441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34989404-0c9e-479c-acd3-c4c802e2a393 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:15.778894 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34989404-0c9e-479c-acd3-c4c802e2a393 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:15.789097 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e749-4674-4ae7-8aed-ab028f4dfe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:15.789717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e749-4674-4ae7-8aed-ab028f4dfe0f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:15.790039 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e749-4674-4ae7-8aed-ab028f4dfe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:15.790383 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891e749-4674-4ae7-8aed-ab028f4dfe0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:15.791870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891e749-4674-4ae7-8aed-ab028f4dfe0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:15.794185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891e749-4674-4ae7-8aed-ab028f4dfe0f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:15.881745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe145-6e32-4bba-9279-39f19d46250a None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:15.881745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe145-6e32-4bba-9279-39f19d46250a None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:15.881745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbe145-6e32-4bba-9279-39f19d46250a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:15.992310 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-d7cbe145-6e32-4bba-9279-39f19d46250a None None] MFA Rules not processed for user `62c00554e5f64843a54c6ab5b04e5238`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:15.993982 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7cbe145-6e32-4bba-9279-39f19d46250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:16.013428 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:16.022183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1367/2725] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:15 2022] POST /identity/v3/projects => generated 377 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:16.042334 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e749-4674-4ae7-8aed-ab028f4dfe0f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:16.096185 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:16.190260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1359/2726] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:16.191947 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbe145-6e32-4bba-9279-39f19d46250a None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:16.193503 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d7cbe145-6e32-4bba-9279-39f19d46250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:16.228864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbe145-6e32-4bba-9279-39f19d46250a None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:16.256374 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891e749-4674-4ae7-8aed-ab028f4dfe0f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:16.263652 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacda9e-77cd-4613-b5ca-5300de8a3e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:16.266394 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacda9e-77cd-4613-b5ca-5300de8a3e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:16.266866 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacda9e-77cd-4613-b5ca-5300de8a3e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:16.267341 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacda9e-77cd-4613-b5ca-5300de8a3e09 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:16.268092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacda9e-77cd-4613-b5ca-5300de8a3e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:16.272578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacda9e-77cd-4613-b5ca-5300de8a3e09 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:16.338724 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750525c9-3a69-4f65-a1f8-71f94298c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:16.339540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750525c9-3a69-4f65-a1f8-71f94298c3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:16.352074 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750525c9-3a69-4f65-a1f8-71f94298c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:16.352697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750525c9-3a69-4f65-a1f8-71f94298c3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:16.354259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750525c9-3a69-4f65-a1f8-71f94298c3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:16.357062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750525c9-3a69-4f65-a1f8-71f94298c3d7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:16.379655 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1368/2727] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:16 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:16.384860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacda9e-77cd-4613-b5ca-5300de8a3e09 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:16.398929 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacda9e-77cd-4613-b5ca-5300de8a3e09 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:16.416972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f92ddb-aac2-4535-889e-b50f38e6aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:16.417598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f92ddb-aac2-4535-889e-b50f38e6aa9d admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:16.417886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f92ddb-aac2-4535-889e-b50f38e6aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:16.418157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f92ddb-aac2-4535-889e-b50f38e6aa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:16.418933 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f92ddb-aac2-4535-889e-b50f38e6aa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:16.420611 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f92ddb-aac2-4535-889e-b50f38e6aa9d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:16.434525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1369/2728] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:16.456521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f92ddb-aac2-4535-889e-b50f38e6aa9d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:16.488441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f92ddb-aac2-4535-889e-b50f38e6aa9d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:16.494368 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e535a50-7187-4773-ac42-139e3eaf3113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:16.495562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e535a50-7187-4773-ac42-139e3eaf3113 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:16.496240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e535a50-7187-4773-ac42-139e3eaf3113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:16.496993 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e535a50-7187-4773-ac42-139e3eaf3113 admin admin] PATH_INFO: `/v3/projects/d3da11d747df4fafb9dc1ec24d0ebf38/users/76800fd5354541ca836ed804c196a974/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:16.503176 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1360/2729] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:16 2022] POST /identity/v3/projects => generated 383 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:16.503176 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750525c9-3a69-4f65-a1f8-71f94298c3d7 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:16.540443 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e535a50-7187-4773-ac42-139e3eaf3113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3da11d747df4fafb9dc1ec24d0ebf38, user_id=76800fd5354541ca836ed804c196a974, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:16.548476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e535a50-7187-4773-ac42-139e3eaf3113 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:16.635625 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1370/2730] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:16 2022] PUT /identity/v3/projects/d3da11d747df4fafb9dc1ec24d0ebf38/users/76800fd5354541ca836ed804c196a974/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:16.641152 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e535a50-7187-4773-ac42-139e3eaf3113 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:16.663705 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750525c9-3a69-4f65-a1f8-71f94298c3d7 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:16.762879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e535a50-7187-4773-ac42-139e3eaf3113 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:16.773389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa2f5d-4b8b-41f1-a18f-b0f76a7d666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:16.774169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2f5d-4b8b-41f1-a18f-b0f76a7d666b admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:16.774460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2f5d-4b8b-41f1-a18f-b0f76a7d666b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:16.774736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa2f5d-4b8b-41f1-a18f-b0f76a7d666b admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:16.775398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa2f5d-4b8b-41f1-a18f-b0f76a7d666b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:16.777187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa2f5d-4b8b-41f1-a18f-b0f76a7d666b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:16.792009 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1371/2731] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:16.797720 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa2f5d-4b8b-41f1-a18f-b0f76a7d666b admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:16.809183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9a5b0-1f8f-4b44-a276-afa810341c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:16.809840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9a5b0-1f8f-4b44-a276-afa810341c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:16.810089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9a5b0-1f8f-4b44-a276-afa810341c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:16.810366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9a5b0-1f8f-4b44-a276-afa810341c69 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:16.811575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9a5b0-1f8f-4b44-a276-afa810341c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:16.816865 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9a5b0-1f8f-4b44-a276-afa810341c69 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:16.840968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa2f5d-4b8b-41f1-a18f-b0f76a7d666b admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:16.864274 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1a4b8-88ef-4525-9e0f-c2434e2cd095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:16.866715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a4b8-88ef-4525-9e0f-c2434e2cd095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:16.867212 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a4b8-88ef-4525-9e0f-c2434e2cd095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:16.867712 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1a4b8-88ef-4525-9e0f-c2434e2cd095 admin admin] PATH_INFO: `/v3/projects/d3da11d747df4fafb9dc1ec24d0ebf38/users/76800fd5354541ca836ed804c196a974/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:16.874373 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1a4b8-88ef-4525-9e0f-c2434e2cd095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3da11d747df4fafb9dc1ec24d0ebf38, user_id=76800fd5354541ca836ed804c196a974, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:16.883108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1a4b8-88ef-4525-9e0f-c2434e2cd095 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:16.897288 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1372/2732] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:16 2022] PUT /identity/v3/projects/d3da11d747df4fafb9dc1ec24d0ebf38/users/76800fd5354541ca836ed804c196a974/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:16.938748 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16e10-ece9-47e2-8fe9-38448e364940 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:16.939425 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16e10-ece9-47e2-8fe9-38448e364940 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:16.940362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e16e10-ece9-47e2-8fe9-38448e364940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:16.964130 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1361/2733] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:16 2022] POST /identity/v3/users => generated 298 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:16.969329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9a5b0-1f8f-4b44-a276-afa810341c69 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:17.016299 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-70e16e10-ece9-47e2-8fe9-38448e364940 None None] MFA Rules not processed for user `76800fd5354541ca836ed804c196a974`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:17.020238 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-70e16e10-ece9-47e2-8fe9-38448e364940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:17.023268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9a5b0-1f8f-4b44-a276-afa810341c69 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:17.125436 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:17.160949 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:17.217910 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:17.218805 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:17.219276 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:17.219703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:17.220554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:17.222686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:17.240696 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1362/2734] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:17.242023 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:17.246467 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:17.270549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1373/2735] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:17.271118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e16e10-ece9-47e2-8fe9-38448e364940 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:17.301521 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e16e10-ece9-47e2-8fe9-38448e364940 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:17.321385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e054a-9a40-4353-a3dc-249d69d65c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:17.322884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e054a-9a40-4353-a3dc-249d69d65c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:17.323179 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e054a-9a40-4353-a3dc-249d69d65c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:17.323466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e054a-9a40-4353-a3dc-249d69d65c84 admin admin] PATH_INFO: `/v3/projects/2a29d95e129b400586fcc716444d42fd/users/208bd5f166dd44aca9e5f66fd29b2e1f/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:17.353852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e054a-9a40-4353-a3dc-249d69d65c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a29d95e129b400586fcc716444d42fd, user_id=208bd5f166dd44aca9e5f66fd29b2e1f, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:17.359583 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e054a-9a40-4353-a3dc-249d69d65c84 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:17.365096 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:17.372860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcf6f3-22d7-49c0-8099-5fcf35b70ac4 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:17.381176 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:17.381814 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:17.382099 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:17.382373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:17.384255 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:17.484508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:17.486063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:17.499814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1374/2736] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:17 2022] PUT /identity/v3/projects/2a29d95e129b400586fcc716444d42fd/users/208bd5f166dd44aca9e5f66fd29b2e1f/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:17.499814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e054a-9a40-4353-a3dc-249d69d65c84 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:17.527495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1363/2737] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:17.528988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:17.556478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057c261-a1d4-4ad0-aadb-93b444181858 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:17.604679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:17.680916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e054a-9a40-4353-a3dc-249d69d65c84 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:17.691939 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:17.692859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:17.693291 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:17.693754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:17.717877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6f1eb-d614-46e1-8fd6-8519d91fcc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:17.720062 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6f1eb-d614-46e1-8fd6-8519d91fcc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:17.720796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6f1eb-d614-46e1-8fd6-8519d91fcc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:17.723227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6f1eb-d614-46e1-8fd6-8519d91fcc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:17.724819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6f1eb-d614-46e1-8fd6-8519d91fcc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:17.726629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6f1eb-d614-46e1-8fd6-8519d91fcc1f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:17.749145 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1364/2738] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:17.759234 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6f1eb-d614-46e1-8fd6-8519d91fcc1f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:17.778885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6f1eb-d614-46e1-8fd6-8519d91fcc1f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:17.786303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84565449-116b-4534-8c47-723331f15629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:17.787393 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84565449-116b-4534-8c47-723331f15629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:17.787891 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84565449-116b-4534-8c47-723331f15629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:17.788347 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84565449-116b-4534-8c47-723331f15629 admin admin] PATH_INFO: `/v3/projects/2a29d95e129b400586fcc716444d42fd/users/208bd5f166dd44aca9e5f66fd29b2e1f/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:17.790800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84565449-116b-4534-8c47-723331f15629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a29d95e129b400586fcc716444d42fd, user_id=208bd5f166dd44aca9e5f66fd29b2e1f, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:17.794210 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84565449-116b-4534-8c47-723331f15629 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:17.826009 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1365/2739] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:17 2022] PUT /identity/v3/projects/2a29d95e129b400586fcc716444d42fd/users/208bd5f166dd44aca9e5f66fd29b2e1f/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:17.932494 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:17.933972 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:17.953737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1375/2740] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:18.016843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:18.108616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:18.112572 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84565449-116b-4534-8c47-723331f15629 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:18.253956 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84565449-116b-4534-8c47-723331f15629 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:18.261819 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f34e8-edf7-4613-928a-dcbc81011aa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:18.262506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f34e8-edf7-4613-928a-dcbc81011aa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:18.263018 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f34e8-edf7-4613-928a-dcbc81011aa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:18.263557 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f34e8-edf7-4613-928a-dcbc81011aa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:18.369217 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f34e8-edf7-4613-928a-dcbc81011aa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:18.370863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f34e8-edf7-4613-928a-dcbc81011aa8 service cinder] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:18.383598 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1366/2741] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:18.433838 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:18.503256 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:18.506417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:18.538660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe0e1d-7ba3-477d-8ae3-58c9255ff470 service cinder] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:18.644276 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:18.645111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:18.645730 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:18.646165 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] PATH_INFO: `/v3/users/0dbda21789f3435ca697068d5caa8cf9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:18.649694 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dbda21789f3435ca697068d5caa8cf9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:18.653538 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:18.769287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:18.876686 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dbda21789f3435ca697068d5caa8cf9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:18.878257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dbda21789f3435ca697068d5caa8cf9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:18.978433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dbda21789f3435ca697068d5caa8cf9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:18.979079 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dbda21789f3435ca697068d5caa8cf9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:18.999206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-042df13d-af88-42ab-9820-ca83509133e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dbda21789f3435ca697068d5caa8cf9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:19.020397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1376/2742] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:18 2022] DELETE /identity/v3/users/0dbda21789f3435ca697068d5caa8cf9 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:19.059648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:19.529495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f34e8-edf7-4613-928a-dcbc81011aa8 service cinder] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:19.557750 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f34e8-edf7-4613-928a-dcbc81011aa8 service cinder] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:19.700036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:19.700682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:19.700967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:19.706353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] PATH_INFO: `/v3/projects/6058dd2384994090bf22318045cca5e0` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:19.706353 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6058dd2384994090bf22318045cca5e0)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:19.712863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:19.777358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:19.946118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6058dd2384994090bf22318045cca5e0', 'request_id': 'req-f21111de-61bf-4fda-a75b-cef02552740c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:20.057723 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6058dd2384994090bf22318045cca5e0', 'request_id': 'req-f21111de-61bf-4fda-a75b-cef02552740c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:20.066676 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6058dd2384994090bf22318045cca5e0', 'request_id': 'req-f21111de-61bf-4fda-a75b-cef02552740c'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:20.095257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] The token cache is being invalidate because project 6058dd2384994090bf22318045cca5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:20.097987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:20.103894 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-f21111de-61bf-4fda-a75b-cef02552740c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:20.111550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1367/2743] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:19 2022] DELETE /identity/v3/projects/6058dd2384994090bf22318045cca5e0 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:20.114809 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33addd30-bd10-4bf1-a4ad-99fc0e213d38 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:20.115525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33addd30-bd10-4bf1-a4ad-99fc0e213d38 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:20.115525 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33addd30-bd10-4bf1-a4ad-99fc0e213d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:20.189620 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-33addd30-bd10-4bf1-a4ad-99fc0e213d38 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:20.192151 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-33addd30-bd10-4bf1-a4ad-99fc0e213d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:20.284046 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1377/2744] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:20.292403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307781-e092-42bd-bfad-b0d51168d096 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:20.292759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307781-e092-42bd-bfad-b0d51168d096 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:20.292997 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307781-e092-42bd-bfad-b0d51168d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:20.324614 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f9307781-e092-42bd-bfad-b0d51168d096 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:20.326402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f9307781-e092-42bd-bfad-b0d51168d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:20.356625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1368/2745] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:20:20.360602 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33addd30-bd10-4bf1-a4ad-99fc0e213d38 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:20.376559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33addd30-bd10-4bf1-a4ad-99fc0e213d38 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:20.382768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:20.383408 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:20.383691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:20.384115 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:20.384833 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:20:20.385601 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:20.387985 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:20.428545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1378/2746] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:20:20.433602 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307781-e092-42bd-bfad-b0d51168d096 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:20.451920 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307781-e092-42bd-bfad-b0d51168d096 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:20.463025 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948d670-2f3c-4d28-840d-c99990e12068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:20.463805 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d670-2f3c-4d28-840d-c99990e12068 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:20.464267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d670-2f3c-4d28-840d-c99990e12068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:20.464577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d670-2f3c-4d28-840d-c99990e12068 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:20.465189 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948d670-2f3c-4d28-840d-c99990e12068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:20.469510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948d670-2f3c-4d28-840d-c99990e12068 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:20.619029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1369/2747] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:20 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:20:20.622336 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:20.696792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca2c9ed-139f-4430-bd94-df5e31fdfea7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:20.701768 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:20.861723 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f9e3d-0301-4d2e-aa03-d281dc3a92e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:20.864113 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f9e3d-0301-4d2e-aa03-d281dc3a92e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:20.864812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f9e3d-0301-4d2e-aa03-d281dc3a92e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:20.866334 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f9e3d-0301-4d2e-aa03-d281dc3a92e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:20.871024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f9e3d-0301-4d2e-aa03-d281dc3a92e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:20.912675 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f9e3d-0301-4d2e-aa03-d281dc3a92e2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:21.156366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1379/2748] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:20 2022] POST /identity/v3/users => generated 284 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:21.160713 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948d670-2f3c-4d28-840d-c99990e12068 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:21.221019 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948d670-2f3c-4d28-840d-c99990e12068 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:21.238132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f812b-986c-4faa-90f7-1d8b94acd87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:21.238682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f812b-986c-4faa-90f7-1d8b94acd87a admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:21.238963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f812b-986c-4faa-90f7-1d8b94acd87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:21.239237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f812b-986c-4faa-90f7-1d8b94acd87a admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:21.239918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f812b-986c-4faa-90f7-1d8b94acd87a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:21.241515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f812b-986c-4faa-90f7-1d8b94acd87a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:21.265728 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1370/2749] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:21.270278 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f9e3d-0301-4d2e-aa03-d281dc3a92e2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:21.284337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f9e3d-0301-4d2e-aa03-d281dc3a92e2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:21.292384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20cfd9-6ab2-4cd9-821b-2f2e87655587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:21.293255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20cfd9-6ab2-4cd9-821b-2f2e87655587 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:21.293663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20cfd9-6ab2-4cd9-821b-2f2e87655587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:21.293944 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20cfd9-6ab2-4cd9-821b-2f2e87655587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:21.294631 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20cfd9-6ab2-4cd9-821b-2f2e87655587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:21.298070 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20cfd9-6ab2-4cd9-821b-2f2e87655587 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:21.315364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1380/2750] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:21.316887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f812b-986c-4faa-90f7-1d8b94acd87a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:21.349672 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f812b-986c-4faa-90f7-1d8b94acd87a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:21.363883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:21.364824 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:21.365265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:21.365697 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] PATH_INFO: `/v3/projects/c31b71e3038242328b1771492db2f17f/users/3a5d3ee1d06b4523be86123cf913d80b/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:21.414566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31b71e3038242328b1771492db2f17f, user_id=3a5d3ee1d06b4523be86123cf913d80b, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:21.415161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:21.525383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1371/2751] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:21 2022] PUT /identity/v3/projects/c31b71e3038242328b1771492db2f17f/users/3a5d3ee1d06b4523be86123cf913d80b/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:21.531897 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181724-fe57-4074-894e-64fb0f354fbc None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:21.532194 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181724-fe57-4074-894e-64fb0f354fbc None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:21.532477 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f181724-fe57-4074-894e-64fb0f354fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:21.586077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-9f181724-fe57-4074-894e-64fb0f354fbc None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:21.587380 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f181724-fe57-4074-894e-64fb0f354fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:21.850114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:21.851850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1381/2752] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:21.852525 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:21.862741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:22.002921 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e18cee-6996-4191-929a-7fb9cbcb52cf admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:22.011373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:22.012423 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:22.012793 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:22.013137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:22.090619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:22.095979 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:22.135933 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1372/2753] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:20:22.578922 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:23.561736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:24.022522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f181724-fe57-4074-894e-64fb0f354fbc None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:24.024188 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-9f181724-fe57-4074-894e-64fb0f354fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:24.042404 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f181724-fe57-4074-894e-64fb0f354fbc None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:24.055180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:24.056109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:24.056418 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:24.060356 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] PATH_INFO: `/v3/users/35338daec9c84343af1481934b3bb4cf` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:24.061727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35338daec9c84343af1481934b3bb4cf)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:24.066992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:24.402395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:24.435560 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35338daec9c84343af1481934b3bb4cf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.441769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35338daec9c84343af1481934b3bb4cf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.486420 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:24.488462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:24.517737 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb63ff3b-6ffe-4a29-babe-429af5a5e30d service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:24.524320 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:24.525057 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:24.525297 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35338daec9c84343af1481934b3bb4cf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.525597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:24.525937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] PATH_INFO: `/v3/users/45937fdd894e42b0ba333c72ce352712` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:24.526214 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35338daec9c84343af1481934b3bb4cf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.528236 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=45937fdd894e42b0ba333c72ce352712)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:24.531164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:24.561555 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-0f7f65f9-3475-4eb3-a077-66d6322d6541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35338daec9c84343af1481934b3bb4cf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.601689 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1382/2754] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:24 2022] DELETE /identity/v3/users/35338daec9c84343af1481934b3bb4cf => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:24.604310 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efcd29-0212-4d08-9158-31d98a063a1b None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:24.604717 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efcd29-0212-4d08-9158-31d98a063a1b None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:24.605109 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efcd29-0212-4d08-9158-31d98a063a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:24.664710 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-24efcd29-0212-4d08-9158-31d98a063a1b None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:24.666996 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-24efcd29-0212-4d08-9158-31d98a063a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:24.749123 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45937fdd894e42b0ba333c72ce352712'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.853906 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45937fdd894e42b0ba333c72ce352712'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.855917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45937fdd894e42b0ba333c72ce352712'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.861171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1383/2755] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:24.868651 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efcd29-0212-4d08-9158-31d98a063a1b None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:24.870261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-24efcd29-0212-4d08-9158-31d98a063a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:24.884597 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45937fdd894e42b0ba333c72ce352712'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.885753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-0fb72fb6-a00e-41c1-89b6-fe5dc88bbeaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45937fdd894e42b0ba333c72ce352712'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:24.947508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1373/2756] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:24 2022] DELETE /identity/v3/users/45937fdd894e42b0ba333c72ce352712 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:24.953137 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb2390-8818-4a5c-9436-af1a0380a488 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:24.953665 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb2390-8818-4a5c-9436-af1a0380a488 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:24.954140 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb2390-8818-4a5c-9436-af1a0380a488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:25.003852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efcd29-0212-4d08-9158-31d98a063a1b None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:25.043199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-28bb2390-8818-4a5c-9436-af1a0380a488 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:25.046013 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-28bb2390-8818-4a5c-9436-af1a0380a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:25.113540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:25.114796 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:25.115308 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:25.116852 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:25.120846 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:25.204081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:25.269546 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1374/2757] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:25.290563 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb2390-8818-4a5c-9436-af1a0380a488 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:25.292298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-28bb2390-8818-4a5c-9436-af1a0380a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:25.314228 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb2390-8818-4a5c-9436-af1a0380a488 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:25.330411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:25.331857 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:25.332433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:25.332884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:25.363931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:25.370053 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:25.371709 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:25.375382 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:25.406031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1375/2758] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:25.406512 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1384/2759] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:25.529092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:26.109227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:26.156541 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:26.784678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:26.786258 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:26.813795 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a006d-0351-4785-b6b0-ef6632ecaf3b service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:26.834639 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:26.837736 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:26.838400 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:26.838686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:26.838966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] PATH_INFO: `/v3/projects/a7ea5833000d4f31bf5924bb3d1dbc7b` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:26.852731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ea5833000d4f31bf5924bb3d1dbc7b)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:26.855031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:26.862015 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:27.092983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ea5833000d4f31bf5924bb3d1dbc7b', 'request_id': 'req-001c8fe9-df63-460e-9995-7ab978723766'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:27.172344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ea5833000d4f31bf5924bb3d1dbc7b', 'request_id': 'req-001c8fe9-df63-460e-9995-7ab978723766'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:27.189658 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ea5833000d4f31bf5924bb3d1dbc7b', 'request_id': 'req-001c8fe9-df63-460e-9995-7ab978723766'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:27.234729 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] The token cache is being invalidate because project a7ea5833000d4f31bf5924bb3d1dbc7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:27.237843 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:27.238207 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:27.241540 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1376/2760] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:26 2022] DELETE /identity/v3/projects/a7ea5833000d4f31bf5924bb3d1dbc7b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:27.247554 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:27.302536 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea8805-1c8f-45de-8511-2013a51876a4 service neutron] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:27.389998 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:27.394510 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:27.683340 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:27.684701 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:27.685171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:27.686665 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] PATH_INFO: `/v3/users/09279053506a4104b42e73f4d2e7ab5d` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:27.694547 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09279053506a4104b42e73f4d2e7ab5d)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:27.697053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:27.744645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c8fe9-df63-460e-9995-7ab978723766 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:27.753577 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:27.755350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:27.756405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:27.756950 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] PATH_INFO: `/v3/projects/03595080e1784ea8bd9bfa6c9652e8bd` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:27.761579 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03595080e1784ea8bd9bfa6c9652e8bd)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:27.766586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:27.976993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:28.027336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03595080e1784ea8bd9bfa6c9652e8bd', 'request_id': 'req-8f923d89-38d5-4e07-b143-a3e20146ba2e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.041388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09279053506a4104b42e73f4d2e7ab5d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.043750 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09279053506a4104b42e73f4d2e7ab5d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.125718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03595080e1784ea8bd9bfa6c9652e8bd', 'request_id': 'req-8f923d89-38d5-4e07-b143-a3e20146ba2e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.146107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03595080e1784ea8bd9bfa6c9652e8bd', 'request_id': 'req-8f923d89-38d5-4e07-b143-a3e20146ba2e'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.163675 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] The token cache is being invalidate because project 03595080e1784ea8bd9bfa6c9652e8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:28.164268 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.175175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.178643 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1377/2761] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:27 2022] DELETE /identity/v3/projects/03595080e1784ea8bd9bfa6c9652e8bd => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:28.192481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09279053506a4104b42e73f4d2e7ab5d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.193531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09279053506a4104b42e73f4d2e7ab5d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.193913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:28.196987 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:28.232370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09279053506a4104b42e73f4d2e7ab5d'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.267317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1385/2762] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:27 2022] DELETE /identity/v3/users/09279053506a4104b42e73f4d2e7ab5d => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:28.402031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923d89-38d5-4e07-b143-a3e20146ba2e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:28.531189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:28.551413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:28.553573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:28.553573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:28.553573 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] PATH_INFO: `/v3/users/0a0a87c2e35e4e49950087ee76bdf0b2` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:28.554425 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0a87c2e35e4e49950087ee76bdf0b2)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:28.562884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:28.802058 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:28.840917 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0a87c2e35e4e49950087ee76bdf0b2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.933324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0a87c2e35e4e49950087ee76bdf0b2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.935010 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0a87c2e35e4e49950087ee76bdf0b2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.962117 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0a87c2e35e4e49950087ee76bdf0b2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:28.963070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0a87c2e35e4e49950087ee76bdf0b2'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:29.041634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1378/2763] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:28 2022] DELETE /identity/v3/users/0a0a87c2e35e4e49950087ee76bdf0b2 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:29.157350 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:29.159765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:29.185997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa227e0e-c985-4126-bd0f-1f9c166706a6 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:29.456510 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:29.460004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:29.460004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:29.462783 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] PATH_INFO: `/v3/projects/8bac0d37c6f146e7841a52e61e5de5f1` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:29.466520 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bac0d37c6f146e7841a52e61e5de5f1)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:29.475533 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:29.543963 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:29.588122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:29.675034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bac0d37c6f146e7841a52e61e5de5f1', 'request_id': 'req-170e4aa7-e628-4a6b-8c0e-436461f0235f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:29.765697 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bac0d37c6f146e7841a52e61e5de5f1', 'request_id': 'req-170e4aa7-e628-4a6b-8c0e-436461f0235f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:29.784888 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bac0d37c6f146e7841a52e61e5de5f1', 'request_id': 'req-170e4aa7-e628-4a6b-8c0e-436461f0235f'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:29.812850 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] The token cache is being invalidate because project 8bac0d37c6f146e7841a52e61e5de5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:29.815903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:29.817753 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:29.822992 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1386/2764] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:29 2022] DELETE /identity/v3/projects/8bac0d37c6f146e7841a52e61e5de5f1 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:29.828454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:29.832283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:29.883190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa124d-7ede-4ec0-8a77-2cacc54ffd89 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:29.953949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:29.954885 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:29.955365 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:29.955895 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] PATH_INFO: `/v3/users/76800fd5354541ca836ed804c196a974` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:29.957759 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76800fd5354541ca836ed804c196a974)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:29.959983 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:29.989760 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:30.221746 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:30.223270 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:30.228906 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76800fd5354541ca836ed804c196a974'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.250714 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4aa7-e628-4a6b-8c0e-436461f0235f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:30.267345 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:30.268857 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:30.273489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:30.273489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] PATH_INFO: `/v3/projects/46ce630a445d46dca8a7a9a5e3fd92ad` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:30.273489 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ce630a445d46dca8a7a9a5e3fd92ad)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:30.275158 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:30.285852 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76800fd5354541ca836ed804c196a974'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.287926 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:30.290720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76800fd5354541ca836ed804c196a974'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.336151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76800fd5354541ca836ed804c196a974'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.336151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76800fd5354541ca836ed804c196a974'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.358692 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1379/2765] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:29 2022] DELETE /identity/v3/users/76800fd5354541ca836ed804c196a974 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:30.406930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ce630a445d46dca8a7a9a5e3fd92ad', 'request_id': 'req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.427537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:30.490924 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ce630a445d46dca8a7a9a5e3fd92ad', 'request_id': 'req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.506618 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ce630a445d46dca8a7a9a5e3fd92ad', 'request_id': 'req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.528570 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] The token cache is being invalidate because project 46ce630a445d46dca8a7a9a5e3fd92ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:30.529339 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.530454 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:30.533211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1387/2766] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:30 2022] DELETE /identity/v3/projects/46ce630a445d46dca8a7a9a5e3fd92ad => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:30.541036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:30.543640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:30.697388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279a30-b698-4b97-8746-cc42a087eeb0 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:30.849273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:30.850218 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:30.850763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:30.852321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] PATH_INFO: `/v3/users/7b398aa58b744cb9be8dc6a3eecb47ae` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:30.859461 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b398aa58b744cb9be8dc6a3eecb47ae)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:30.862454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:30.920045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:31.190969 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:31.194289 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:31.244258 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b398aa58b744cb9be8dc6a3eecb47ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:31.248592 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a3bc3-e1bd-47b9-b49e-1a2dd671dc9e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:31.282342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:31.283257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:31.285053 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:31.285517 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] PATH_INFO: `/v3/projects/d3da11d747df4fafb9dc1ec24d0ebf38` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:31.291302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3da11d747df4fafb9dc1ec24d0ebf38)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:31.294050 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:31.350117 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:31.382360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b398aa58b744cb9be8dc6a3eecb47ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:31.385011 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b398aa58b744cb9be8dc6a3eecb47ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:31.408478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b398aa58b744cb9be8dc6a3eecb47ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:31.410063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-fcfdbdcb-45a0-4923-bcda-eac7fc6f5ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b398aa58b744cb9be8dc6a3eecb47ae'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:31.435223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1380/2767] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:30 2022] DELETE /identity/v3/users/7b398aa58b744cb9be8dc6a3eecb47ae => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:31.445388 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3498-b2ef-4ae4-bdcc-c618fdf37909 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:31.445683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3498-b2ef-4ae4-bdcc-c618fdf37909 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:31.445967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3498-b2ef-4ae4-bdcc-c618fdf37909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:31.530848 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-543f3498-b2ef-4ae4-bdcc-c618fdf37909 None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:31.540147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-543f3498-b2ef-4ae4-bdcc-c618fdf37909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:31.562452 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3da11d747df4fafb9dc1ec24d0ebf38', 'request_id': 'req-7411cd40-faae-4c5f-93f2-0541bdc0190c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:31.736625 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1381/2768] 10.222.0.82 () {58 vars in 967 bytes} [Mon Aug 29 19:20:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:31.757389 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f3498-b2ef-4ae4-bdcc-c618fdf37909 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:31.759640 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-543f3498-b2ef-4ae4-bdcc-c618fdf37909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:31.894937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f3498-b2ef-4ae4-bdcc-c618fdf37909 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:31.900644 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65c1b7-645a-49b1-b15a-079ff924725a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:31.901424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c1b7-645a-49b1-b15a-079ff924725a service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:31.901715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c1b7-645a-49b1-b15a-079ff924725a service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:31.902002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65c1b7-645a-49b1-b15a-079ff924725a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:31.912598 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3da11d747df4fafb9dc1ec24d0ebf38', 'request_id': 'req-7411cd40-faae-4c5f-93f2-0541bdc0190c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:31.915649 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65c1b7-645a-49b1-b15a-079ff924725a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:31.917379 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65c1b7-645a-49b1-b15a-079ff924725a service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:31.925798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3da11d747df4fafb9dc1ec24d0ebf38', 'request_id': 'req-7411cd40-faae-4c5f-93f2-0541bdc0190c'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:31.929031 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1382/2769] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:20:32.025944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7378bb-32fd-4c6d-87c5-77e3b1a0a3d3 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:32.025944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7378bb-32fd-4c6d-87c5-77e3b1a0a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:32.025944 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7378bb-32fd-4c6d-87c5-77e3b1a0a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:32.028149 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] The token cache is being invalidate because project d3da11d747df4fafb9dc1ec24d0ebf38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:32.028453 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:32.041271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7411cd40-faae-4c5f-93f2-0541bdc0190c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:32.043094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1388/2770] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:31 2022] DELETE /identity/v3/projects/d3da11d747df4fafb9dc1ec24d0ebf38 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:32.050506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4707120-173f-44e8-af31-b7e5a9589437 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:32.051426 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4707120-173f-44e8-af31-b7e5a9589437 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:32.052332 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4707120-173f-44e8-af31-b7e5a9589437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:32.085398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d4707120-173f-44e8-af31-b7e5a9589437 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:32.086874 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d4707120-173f-44e8-af31-b7e5a9589437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:32.116294 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0b7378bb-32fd-4c6d-87c5-77e3b1a0a3d3 None None] MFA Rules not processed for user `208bd5f166dd44aca9e5f66fd29b2e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:32.120202 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0b7378bb-32fd-4c6d-87c5-77e3b1a0a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:32.272063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1383/2771] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:32.282684 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1389/2772] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:32.289564 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7378bb-32fd-4c6d-87c5-77e3b1a0a3d3 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:32.292877 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0b7378bb-32fd-4c6d-87c5-77e3b1a0a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:32.294785 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28ccb-317f-44c2-922e-ea17a25004be None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:32.295077 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28ccb-317f-44c2-922e-ea17a25004be None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:32.295352 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e28ccb-317f-44c2-922e-ea17a25004be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:32.344446 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d4e28ccb-317f-44c2-922e-ea17a25004be None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:32.348765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d4e28ccb-317f-44c2-922e-ea17a25004be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:32.381173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1390/2773] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:32.385786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28ccb-317f-44c2-922e-ea17a25004be None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:32.405319 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e28ccb-317f-44c2-922e-ea17a25004be None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:32.419379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:32.424414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:32.424414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:32.424414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:32.424414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:20:32.426750 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:32.430023 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:32.470063 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1391/2774] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:20:32.473531 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:32.481890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:32.503515 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7b484-4982-44b2-9e22-935113a1eec2 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:32.517370 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6ee1-f205-4210-b394-19d83c6e867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:32.521992 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7378bb-32fd-4c6d-87c5-77e3b1a0a3d3 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:32.522177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6ee1-f205-4210-b394-19d83c6e867d admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:32.522177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6ee1-f205-4210-b394-19d83c6e867d admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:32.522177 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6ee1-f205-4210-b394-19d83c6e867d admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:32.522916 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b6ee1-f205-4210-b394-19d83c6e867d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:32.528137 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b6ee1-f205-4210-b394-19d83c6e867d admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:32.528832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5786ad6388c54a3f82955e12e8e8f8b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:32.529550 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:32.529838 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:32.530656 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:32.543248 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:32.625674 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:32.662613 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1392/2775] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:32 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:32.666769 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6ee1-f205-4210-b394-19d83c6e867d admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:32.723883 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:32.726392 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:32.757416 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1384/2776] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:20:32.758914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:32.763856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:32.783321 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6ee1-f205-4210-b394-19d83c6e867d admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:32.790458 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b01d2-8c79-4e34-8082-20256ede4a9c service glance] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:32.797160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8705d2-cff8-4527-a836-741a089a450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:32.798060 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8705d2-cff8-4527-a836-741a089a450f admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:32.798546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8705d2-cff8-4527-a836-741a089a450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:32.799692 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8705d2-cff8-4527-a836-741a089a450f admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:32.800859 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8705d2-cff8-4527-a836-741a089a450f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:32.805704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8705d2-cff8-4527-a836-741a089a450f admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:32.806629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:32.808673 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:32.809158 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:32.809616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] PATH_INFO: `/v3/projects/23fc360f9f1c40a194e35e639f8e6117` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:32.812815 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23fc360f9f1c40a194e35e639f8e6117)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:32.817287 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:32.967419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1393/2777] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:32 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:32.972397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8705d2-cff8-4527-a836-741a089a450f admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:32.986458 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8705d2-cff8-4527-a836-741a089a450f admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:33.026704 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3e09-973d-4ad9-9305-1f406905d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:33.027346 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3e09-973d-4ad9-9305-1f406905d17e admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.027623 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3e09-973d-4ad9-9305-1f406905d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.027964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3e09-973d-4ad9-9305-1f406905d17e admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.039787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3e09-973d-4ad9-9305-1f406905d17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:33.039787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b3e09-973d-4ad9-9305-1f406905d17e admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:33.056777 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1394/2778] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:33.057795 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3e09-973d-4ad9-9305-1f406905d17e admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:33.077351 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3e09-973d-4ad9-9305-1f406905d17e admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:33.087274 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23fc360f9f1c40a194e35e639f8e6117', 'request_id': 'req-73213870-0a31-4f68-bf5b-daa32c0d74f5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:33.099793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.188386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23fc360f9f1c40a194e35e639f8e6117', 'request_id': 'req-73213870-0a31-4f68-bf5b-daa32c0d74f5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:33.212810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23fc360f9f1c40a194e35e639f8e6117', 'request_id': 'req-73213870-0a31-4f68-bf5b-daa32c0d74f5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:33.255937 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] The token cache is being invalidate because project 23fc360f9f1c40a194e35e639f8e6117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:33.256491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:33.258336 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-73213870-0a31-4f68-bf5b-daa32c0d74f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:33.267304 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1385/2779] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:32 2022] DELETE /identity/v3/projects/23fc360f9f1c40a194e35e639f8e6117 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:33.270109 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d1e5-7cee-4d1e-8f78-79ebe76416b6 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.270402 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d1e5-7cee-4d1e-8f78-79ebe76416b6 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.270683 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6d1e5-7cee-4d1e-8f78-79ebe76416b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.295428 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de1767-b99c-4fb3-bd88-876f92bc42ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:33.296846 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1767-b99c-4fb3-bd88-876f92bc42ec admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.297562 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1767-b99c-4fb3-bd88-876f92bc42ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.298283 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1767-b99c-4fb3-bd88-876f92bc42ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.300342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de1767-b99c-4fb3-bd88-876f92bc42ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:33.303399 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de1767-b99c-4fb3-bd88-876f92bc42ec admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:33.309153 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-e6d6d1e5-7cee-4d1e-8f78-79ebe76416b6 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:33.310408 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e6d6d1e5-7cee-4d1e-8f78-79ebe76416b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:33.321691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1395/2780] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:33.326240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5b7b-508f-435f-a154-b14bfbc12472 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.332136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5b7b-508f-435f-a154-b14bfbc12472 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.333128 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca5b7b-508f-435f-a154-b14bfbc12472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.334986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1386/2781] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:33.336021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6d1e5-7cee-4d1e-8f78-79ebe76416b6 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:33.340881 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-e6d6d1e5-7cee-4d1e-8f78-79ebe76416b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:33.366892 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6d1e5-7cee-4d1e-8f78-79ebe76416b6 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:33.382907 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732b228-1f30-4f86-ad9c-4c851766e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:33.386070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b228-1f30-4f86-ad9c-4c851766e5d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.386070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b228-1f30-4f86-ad9c-4c851766e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.386070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b228-1f30-4f86-ad9c-4c851766e5d3 admin admin] PATH_INFO: `/v3/projects/579ab134c2124f668dd0f55d4cbf4025/users/7839321e9fd94ad8b75adf8555513db4/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.407476 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c3ca5b7b-508f-435f-a154-b14bfbc12472 None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:33.410000 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c3ca5b7b-508f-435f-a154-b14bfbc12472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:33.431426 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732b228-1f30-4f86-ad9c-4c851766e5d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579ab134c2124f668dd0f55d4cbf4025, user_id=7839321e9fd94ad8b75adf8555513db4, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:33.434566 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732b228-1f30-4f86-ad9c-4c851766e5d3 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:33.513821 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1387/2782] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:33 2022] PUT /identity/v3/projects/579ab134c2124f668dd0f55d4cbf4025/users/7839321e9fd94ad8b75adf8555513db4/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:33.522551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681853-3ccc-478b-a352-886ee6d035a0 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.522551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681853-3ccc-478b-a352-886ee6d035a0 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.522551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681853-3ccc-478b-a352-886ee6d035a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.551236 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1396/2783] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:33.553576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157afc6-1082-4410-9c33-053f50410c5d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.554017 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157afc6-1082-4410-9c33-053f50410c5d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.554442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157afc6-1082-4410-9c33-053f50410c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.580270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-db681853-3ccc-478b-a352-886ee6d035a0 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:33.582699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-db681853-3ccc-478b-a352-886ee6d035a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:33.602470 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-7157afc6-1082-4410-9c33-053f50410c5d None None] MFA Rules not processed for user `7839321e9fd94ad8b75adf8555513db4`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:33.604764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-7157afc6-1082-4410-9c33-053f50410c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:33.631787 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.679288 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.702692 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1388/2784] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:33.706472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681853-3ccc-478b-a352-886ee6d035a0 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:33.706472 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-db681853-3ccc-478b-a352-886ee6d035a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:33.735506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1397/2785] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:33.757199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157afc6-1082-4410-9c33-053f50410c5d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:33.794827 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157afc6-1082-4410-9c33-053f50410c5d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:33.816725 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:33.817375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.817660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.817934 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] PATH_INFO: `/v3/domains` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.819133 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81882) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:20:33.819441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:33.823659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:33.849271 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:33.864727 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1398/2786] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:20:33.875124 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681853-3ccc-478b-a352-886ee6d035a0 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:33.876514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:33.882134 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:33.899714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b4aee-5fdb-42bb-8dcb-cc36169e2119 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:33.899714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4aee-5fdb-42bb-8dcb-cc36169e2119 service swift] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:33.899714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4aee-5fdb-42bb-8dcb-cc36169e2119 service swift] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:33.899714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b4aee-5fdb-42bb-8dcb-cc36169e2119 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:33.989251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b4aee-5fdb-42bb-8dcb-cc36169e2119 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:33.991182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b4aee-5fdb-42bb-8dcb-cc36169e2119 service swift] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:33.996502 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa1c89-3328-49b9-a8fa-3b57c721e226 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:34.004607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1389/2787] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:20:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 19:20:34.005454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b4aee-5fdb-42bb-8dcb-cc36169e2119 service swift] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:34.006861 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f15-0930-42e5-a80c-62523cf6b4a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5786ad6388c54a3f82955e12e8e8f8b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:34.007413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f15-0930-42e5-a80c-62523cf6b4a7 service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:34.007815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f15-0930-42e5-a80c-62523cf6b4a7 service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:34.011262 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c0f15-0930-42e5-a80c-62523cf6b4a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:34.018822 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b4aee-5fdb-42bb-8dcb-cc36169e2119 service swift] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:34.024111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c0f15-0930-42e5-a80c-62523cf6b4a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:34.026176 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d420-46bb-40c3-ba43-0697cd947809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:34.026810 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d420-46bb-40c3-ba43-0697cd947809 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:34.027087 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d420-46bb-40c3-ba43-0697cd947809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:34.027358 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d420-46bb-40c3-ba43-0697cd947809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:34.028030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71d420-46bb-40c3-ba43-0697cd947809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:34.028156 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c0f15-0930-42e5-a80c-62523cf6b4a7 service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:34.030088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71d420-46bb-40c3-ba43-0697cd947809 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:34.046630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1399/2788] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:34.195801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1390/2789] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:34 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:34.200414 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f15-0930-42e5-a80c-62523cf6b4a7 service glance] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:34.240213 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c0f15-0930-42e5-a80c-62523cf6b4a7 service glance] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:34.413475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda6fa-8f7e-49c1-b176-ab0e2cf7efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:34.424087 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda6fa-8f7e-49c1-b176-ab0e2cf7efcb admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:34.425025 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda6fa-8f7e-49c1-b176-ab0e2cf7efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:34.426638 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dda6fa-8f7e-49c1-b176-ab0e2cf7efcb admin admin] PATH_INFO: `/v3/users` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:34.427545 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dda6fa-8f7e-49c1-b176-ab0e2cf7efcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:34.440466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dda6fa-8f7e-49c1-b176-ab0e2cf7efcb admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:34.536227 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:34.585089 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1400/2790] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:34 2022] POST /identity/v3/users => generated 285 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:34.589405 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d420-46bb-40c3-ba43-0697cd947809 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:34.611601 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d420-46bb-40c3-ba43-0697cd947809 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:34.634367 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47011c6-15ec-42e7-8e0d-7f78b475fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:34.636297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47011c6-15ec-42e7-8e0d-7f78b475fd51 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:34.636297 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47011c6-15ec-42e7-8e0d-7f78b475fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:34.639175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47011c6-15ec-42e7-8e0d-7f78b475fd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:34.640714 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47011c6-15ec-42e7-8e0d-7f78b475fd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:34.654277 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47011c6-15ec-42e7-8e0d-7f78b475fd51 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:34.659330 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:34.704305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1391/2791] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:20:34.707034 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda6fa-8f7e-49c1-b176-ab0e2cf7efcb admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:34.734232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dda6fa-8f7e-49c1-b176-ab0e2cf7efcb admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:34.769544 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7b524-30a4-41e9-a87a-fa0d037f96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:34.770522 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b524-30a4-41e9-a87a-fa0d037f96af admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:34.771004 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b524-30a4-41e9-a87a-fa0d037f96af admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:34.771455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7b524-30a4-41e9-a87a-fa0d037f96af admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:34.772317 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7b524-30a4-41e9-a87a-fa0d037f96af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:34.774816 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7b524-30a4-41e9-a87a-fa0d037f96af admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:34.801338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1401/2792] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:34.805508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47011c6-15ec-42e7-8e0d-7f78b475fd51 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:34.821554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47011c6-15ec-42e7-8e0d-7f78b475fd51 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:34.841873 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca075a9-0127-462b-ac49-329e7afbb53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:34.843896 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca075a9-0127-462b-ac49-329e7afbb53a admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:34.850725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca075a9-0127-462b-ac49-329e7afbb53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:34.850725 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca075a9-0127-462b-ac49-329e7afbb53a admin admin] PATH_INFO: `/v3/projects/81627970d2354f268b26ba44a4897049/users/3ff3eb8b29c348989c100ed8d4292c08/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:34.866678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca075a9-0127-462b-ac49-329e7afbb53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=81627970d2354f268b26ba44a4897049, user_id=3ff3eb8b29c348989c100ed8d4292c08, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:34.869855 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca075a9-0127-462b-ac49-329e7afbb53a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:34.983608 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1392/2793] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:34 2022] PUT /identity/v3/projects/81627970d2354f268b26ba44a4897049/users/3ff3eb8b29c348989c100ed8d4292c08/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:35.005488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928651-4fe8-4e06-9d17-c4c6f1561836 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:35.005488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928651-4fe8-4e06-9d17-c4c6f1561836 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:35.005488 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f928651-4fe8-4e06-9d17-c4c6f1561836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:35.089676 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-3f928651-4fe8-4e06-9d17-c4c6f1561836 None None] MFA Rules not processed for user `3ff3eb8b29c348989c100ed8d4292c08`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:35.091067 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3f928651-4fe8-4e06-9d17-c4c6f1561836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:35.210360 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:35.282397 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:35.336615 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1402/2794] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:35.348355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca075a9-0127-462b-ac49-329e7afbb53a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:35.633768 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca075a9-0127-462b-ac49-329e7afbb53a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:35.665331 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5786ad6388c54a3f82955e12e8e8f8b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:35.666552 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:35.666835 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:35.667173 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:35.693495 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:35.701068 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:35.707591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:35.760826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:35.778386 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1393/2795] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:35.936324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:36.062306 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:36.147445 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:36.313466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:36.402433 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ee86-9c26-49b3-941b-1ab19036d80c None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:36.403107 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ee86-9c26-49b3-941b-1ab19036d80c None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:36.404379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ee86-9c26-49b3-941b-1ab19036d80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:36.502277 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-2f97ee86-9c26-49b3-941b-1ab19036d80c None None] MFA Rules not processed for user `3a5d3ee1d06b4523be86123cf913d80b`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:36.506076 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2f97ee86-9c26-49b3-941b-1ab19036d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:36.508720 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:36.657794 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:36.746035 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1403/2796] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:36.754913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:36.757081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:36.915828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49a2a-c372-488d-8733-3293a84eb76d service glance] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:36.934668 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0713d4-ff90-4715-9982-0a5b66a3da1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:36.936345 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0713d4-ff90-4715-9982-0a5b66a3da1a admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:36.936931 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0713d4-ff90-4715-9982-0a5b66a3da1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:36.937636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0713d4-ff90-4715-9982-0a5b66a3da1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:36.938703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0713d4-ff90-4715-9982-0a5b66a3da1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:36.941586 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0713d4-ff90-4715-9982-0a5b66a3da1a admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:36.994191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:37.012738 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97ee86-9c26-49b3-941b-1ab19036d80c None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:37.014239 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-2f97ee86-9c26-49b3-941b-1ab19036d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:37.051506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97ee86-9c26-49b3-941b-1ab19036d80c None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:37.075568 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1394/2797] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:36 2022] POST /identity/v3/projects => generated 373 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:37.085369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:37.085369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:37.085369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:37.085369 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] PATH_INFO: `/v3/users/3d41884785b94114ac36ae1f833121b0` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:37.086132 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d41884785b94114ac36ae1f833121b0)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:37.086958 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:37.095022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0713d4-ff90-4715-9982-0a5b66a3da1a admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:37.139641 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:37.299041 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0713d4-ff90-4715-9982-0a5b66a3da1a admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:37.310032 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:37.310744 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:37.311180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:37.311464 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:37.312588 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:37.314490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:37.318928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d41884785b94114ac36ae1f833121b0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:37.323222 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d41884785b94114ac36ae1f833121b0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:37.418157 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1395/2798] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:37 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:37.424081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:37.430300 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:37.433457 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d41884785b94114ac36ae1f833121b0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:37.434147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d41884785b94114ac36ae1f833121b0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:37.441327 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:37.457831 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d41884785b94114ac36ae1f833121b0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:37.460283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2f855-dbe8-462c-89ae-eb6e128c1833 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:37.474629 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e6c3-cca8-4667-b9c9-ac8167cfa2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:37.475575 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e6c3-cca8-4667-b9c9-ac8167cfa2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:37.477754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e6c3-cca8-4667-b9c9-ac8167cfa2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:37.477754 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e6c3-cca8-4667-b9c9-ac8167cfa2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:37.481063 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9e6c3-cca8-4667-b9c9-ac8167cfa2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:37.483485 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9e6c3-cca8-4667-b9c9-ac8167cfa2d1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:37.490342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1404/2799] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:37 2022] DELETE /identity/v3/users/3d41884785b94114ac36ae1f833121b0 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:37.497549 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:37.507784 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1396/2800] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:20:37.515558 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:37.647169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238d0282-16f0-4a52-8794-4013223b3bd3 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:37.662818 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:37.667124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:37.667124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:37.667124 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] PATH_INFO: `/v3/projects/b9ee2ad1ebb84545bc0ac7c50943a88d/users/05761129815b49ada417b947669a6c26/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:37.698261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ee2ad1ebb84545bc0ac7c50943a88d, user_id=05761129815b49ada417b947669a6c26, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:37.702757 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:37.712884 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:37.725095 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:37.794971 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1405/2801] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:37 2022] PUT /identity/v3/projects/b9ee2ad1ebb84545bc0ac7c50943a88d/users/05761129815b49ada417b947669a6c26/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:37.801167 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e6c3-cca8-4667-b9c9-ac8167cfa2d1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:37.882940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9e6c3-cca8-4667-b9c9-ac8167cfa2d1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:38.125860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5776-cbe1-4dae-9e34-d61128c90171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:38.126967 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5776-cbe1-4dae-9e34-d61128c90171 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:38.128147 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5776-cbe1-4dae-9e34-d61128c90171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:38.128561 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5776-cbe1-4dae-9e34-d61128c90171 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:38.130717 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d5776-cbe1-4dae-9e34-d61128c90171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:38.147923 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d5776-cbe1-4dae-9e34-d61128c90171 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:38.153622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:38.157263 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:38.180823 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1397/2802] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:38.191174 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5776-cbe1-4dae-9e34-d61128c90171 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:38.211199 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea4589-f4b8-4649-9b3e-4b135ae52866 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:38.215846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5776-cbe1-4dae-9e34-d61128c90171 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:38.223443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20cb672-500d-4390-8242-a60a1cdd401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:38.225490 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb672-500d-4390-8242-a60a1cdd401c admin admin] REQUEST_METHOD: `PUT` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:38.226003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:38.226322 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb672-500d-4390-8242-a60a1cdd401c admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:38.226868 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20cb672-500d-4390-8242-a60a1cdd401c admin admin] PATH_INFO: `/v3/projects/b9ee2ad1ebb84545bc0ac7c50943a88d/users/05761129815b49ada417b947669a6c26/roles/3925fcafb9614006a2cfc4cee7429b52` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:38.227691 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:38.228240 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:38.229022 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] PATH_INFO: `/v3/projects/3c861155243b473b9269dd1076e46fa9` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:38.232680 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c861155243b473b9269dd1076e46fa9)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:38.235366 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:38.256786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cb672-500d-4390-8242-a60a1cdd401c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ee2ad1ebb84545bc0ac7c50943a88d, user_id=05761129815b49ada417b947669a6c26, role_id=3925fcafb9614006a2cfc4cee7429b52)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:38.277328 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20cb672-500d-4390-8242-a60a1cdd401c admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:38.337875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1398/2803] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:38 2022] PUT /identity/v3/projects/b9ee2ad1ebb84545bc0ac7c50943a88d/users/05761129815b49ada417b947669a6c26/roles/3925fcafb9614006a2cfc4cee7429b52 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:38.519442 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c861155243b473b9269dd1076e46fa9', 'request_id': 'req-d47a93e7-426e-4696-bb5c-f15d187c02bf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:38.549107 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:38.616364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:38.654424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c861155243b473b9269dd1076e46fa9', 'request_id': 'req-d47a93e7-426e-4696-bb5c-f15d187c02bf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:38.669597 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c861155243b473b9269dd1076e46fa9', 'request_id': 'req-d47a93e7-426e-4696-bb5c-f15d187c02bf'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:38.720155 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] The token cache is being invalidate because project 3c861155243b473b9269dd1076e46fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:38.721422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:38.722649 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-d47a93e7-426e-4696-bb5c-f15d187c02bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:38.726883 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1406/2804] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:38 2022] DELETE /identity/v3/projects/3c861155243b473b9269dd1076e46fa9 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:38.733134 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5cd96-57a0-47c7-96bc-da3a0f93147f None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:38.736476 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5cd96-57a0-47c7-96bc-da3a0f93147f None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:38.736476 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5cd96-57a0-47c7-96bc-da3a0f93147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:38.772828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-99f5cd96-57a0-47c7-96bc-da3a0f93147f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:38.777221 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-99f5cd96-57a0-47c7-96bc-da3a0f93147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:39.024223 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1399/2805] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:39.032136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974af29-d758-42c7-acfb-6f09ddb1462f None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:39.032136 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974af29-d758-42c7-acfb-6f09ddb1462f None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:39.032679 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974af29-d758-42c7-acfb-6f09ddb1462f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:39.087621 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-8974af29-d758-42c7-acfb-6f09ddb1462f None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:39.098815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-8974af29-d758-42c7-acfb-6f09ddb1462f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:39.126424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1407/2806] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:39.131021 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5cd96-57a0-47c7-96bc-da3a0f93147f None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:39.150163 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5cd96-57a0-47c7-96bc-da3a0f93147f None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:39.163867 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:39.164600 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:39.164840 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:39.165105 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:39.166151 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:20:39.169339 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:39.170791 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:39.209656 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974af29-d758-42c7-acfb-6f09ddb1462f None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:39.220237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1400/2807] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:20:39.246315 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974af29-d758-42c7-acfb-6f09ddb1462f None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:39.260092 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4b992-2acc-45e6-8410-a23b55cd9a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:39.260988 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4b992-2acc-45e6-8410-a23b55cd9a9c admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:39.261353 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4b992-2acc-45e6-8410-a23b55cd9a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:39.261715 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4b992-2acc-45e6-8410-a23b55cd9a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:39.262460 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4b992-2acc-45e6-8410-a23b55cd9a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:39.264804 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4b992-2acc-45e6-8410-a23b55cd9a9c admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:39.456445 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1408/2808] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:20:39 2022] POST /identity/v3/projects => generated 397 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:20:39.461887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:39.496346 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b2fb1-0f15-4f6e-ad3f-eb40228ab45f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:39.706798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158a900-4ec0-421f-a67e-22e3a60ca11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:39.707935 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158a900-4ec0-421f-a67e-22e3a60ca11e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:39.708204 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158a900-4ec0-421f-a67e-22e3a60ca11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:39.708678 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158a900-4ec0-421f-a67e-22e3a60ca11e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:39.710716 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158a900-4ec0-421f-a67e-22e3a60ca11e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:39.720693 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158a900-4ec0-421f-a67e-22e3a60ca11e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:39.748224 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:39.805413 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:39.848603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1401/2809] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:20:39 2022] POST /identity/v3/users => generated 299 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:20:39.852903 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4b992-2acc-45e6-8410-a23b55cd9a9c admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:39.902364 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4b992-2acc-45e6-8410-a23b55cd9a9c admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:39.917484 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409ed44-b966-48f1-bc91-d7a1d8c437ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:39.918514 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409ed44-b966-48f1-bc91-d7a1d8c437ab admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:39.918955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409ed44-b966-48f1-bc91-d7a1d8c437ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:39.919391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409ed44-b966-48f1-bc91-d7a1d8c437ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:39.920327 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409ed44-b966-48f1-bc91-d7a1d8c437ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:39.922586 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409ed44-b966-48f1-bc91-d7a1d8c437ab admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:39.942550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1409/2810] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:39.944410 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158a900-4ec0-421f-a67e-22e3a60ca11e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:39.978412 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158a900-4ec0-421f-a67e-22e3a60ca11e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:40.010403 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89defeb-0798-4979-9e68-b80811005326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:40.011344 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89defeb-0798-4979-9e68-b80811005326 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:40.011630 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89defeb-0798-4979-9e68-b80811005326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:40.011940 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89defeb-0798-4979-9e68-b80811005326 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:40.012633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89defeb-0798-4979-9e68-b80811005326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:40.018786 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89defeb-0798-4979-9e68-b80811005326 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:40.052718 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1402/2811] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:20:40.054630 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409ed44-b966-48f1-bc91-d7a1d8c437ab admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:40.078877 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409ed44-b966-48f1-bc91-d7a1d8c437ab admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:40.085931 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:40.088139 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:40.088975 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:40.089329 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] PATH_INFO: `/v3/projects/b5fe828c185c481fab1b7fac85299e1d/users/db13b83f151142cf8348a026e6564dc5/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:40.143886 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fe828c185c481fab1b7fac85299e1d, user_id=db13b83f151142cf8348a026e6564dc5, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:40.157337 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:40.182731 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:40.277434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1410/2812] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:20:40 2022] PUT /identity/v3/projects/b5fe828c185c481fab1b7fac85299e1d/users/db13b83f151142cf8348a026e6564dc5/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:20:40.291603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6a5b-c5db-43cc-8e4e-dc98c47deb1d None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:40.292259 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6a5b-c5db-43cc-8e4e-dc98c47deb1d None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:40.292864 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6a5b-c5db-43cc-8e4e-dc98c47deb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:40.303951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:40.369263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-731c6a5b-c5db-43cc-8e4e-dc98c47deb1d None None] MFA Rules not processed for user `db13b83f151142cf8348a026e6564dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:40.370856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-731c6a5b-c5db-43cc-8e4e-dc98c47deb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:40.591257 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1403/2813] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:40.618648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:40.621135 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:40.784267 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:40.826788 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c196668-ff92-44af-bab1-ff2f58450f73 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:40.839523 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b60f4-85f1-4ca6-8e2d-9835bff2e36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:40.840659 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b60f4-85f1-4ca6-8e2d-9835bff2e36d service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:40.845013 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b60f4-85f1-4ca6-8e2d-9835bff2e36d service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:40.845696 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b60f4-85f1-4ca6-8e2d-9835bff2e36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:40.855968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:40.895648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b60f4-85f1-4ca6-8e2d-9835bff2e36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:40.901798 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b60f4-85f1-4ca6-8e2d-9835bff2e36d service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:40.948471 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1411/2814] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:41.502952 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:41.816440 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:42.313388 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:42.395183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:42.810882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:43.083930 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:43.494794 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:43.703191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:44.213664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:44.332492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:44.520284 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:44.776086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:44.914607 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.342044 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.358826 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.428725 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.479936 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.605364 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.691062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.818845 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.878893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:45.993348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:46.027955 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:46.092272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:46.521475 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:46.764323 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:46.827238 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.213532 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.285738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.451462 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.466265 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c6a5b-c5db-43cc-8e4e-dc98c47deb1d None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:48.553810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.639571 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.694519 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c6a5b-c5db-43cc-8e4e-dc98c47deb1d None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:48.706312 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:48.706842 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:48.707334 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:48.707908 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] PATH_INFO: `/v3/users/db13b83f151142cf8348a026e6564dc5` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:48.715951 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db13b83f151142cf8348a026e6564dc5)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:48.718436 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.719620 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:48.777607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.995704 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:48.996273 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5bb3-3d59-49ac-90fc-be464a17c164 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:49.001902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5bb3-3d59-49ac-90fc-be464a17c164 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:49.001902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f5bb3-3d59-49ac-90fc-be464a17c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:49.003030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db13b83f151142cf8348a026e6564dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:49.038731 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.064024 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-d04f5bb3-3d59-49ac-90fc-be464a17c164 None None] MFA Rules not processed for user `05761129815b49ada417b947669a6c26`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:49.069719 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d04f5bb3-3d59-49ac-90fc-be464a17c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:49.118453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db13b83f151142cf8348a026e6564dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:49.131949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db13b83f151142cf8348a026e6564dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:49.191034 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db13b83f151142cf8348a026e6564dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:49.192554 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-3706d3b0-4cd9-4b98-9357-db2acbf1f056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db13b83f151142cf8348a026e6564dc5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:49.261056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1404/2815] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:20:48 2022] DELETE /identity/v3/users/db13b83f151142cf8348a026e6564dc5 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:49.265958 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ddbe4-89b2-49d4-ab39-febe169378d1 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:49.266249 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ddbe4-89b2-49d4-ab39-febe169378d1 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:49.266544 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ddbe4-89b2-49d4-ab39-febe169378d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:49.294612 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1412/2816] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:20:49.313011 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f5bb3-3d59-49ac-90fc-be464a17c164 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:49.316323 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.317893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-d04f5bb3-3d59-49ac-90fc-be464a17c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:49.331738 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0e8ddbe4-89b2-49d4-ab39-febe169378d1 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:49.336991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0e8ddbe4-89b2-49d4-ab39-febe169378d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:49.351398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.486026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f5bb3-3d59-49ac-90fc-be464a17c164 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:49.509071 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.569275 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.581413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1405/2817] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:49.601837 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ddbe4-89b2-49d4-ab39-febe169378d1 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:49.604591 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0e8ddbe4-89b2-49d4-ab39-febe169378d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:49.651261 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd08bc5-ec9d-4c9f-9936-c44e0cb2392c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e02a03585caf46fdb09b4a2fdde91a51', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:49.654106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd08bc5-ec9d-4c9f-9936-c44e0cb2392c service nova] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:49.654778 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd08bc5-ec9d-4c9f-9936-c44e0cb2392c service nova] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:49.655530 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd08bc5-ec9d-4c9f-9936-c44e0cb2392c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:49.667254 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6bd08bc5-ec9d-4c9f-9936-c44e0cb2392c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:49.685030 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.711604 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.741534 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.856622 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ddbe4-89b2-49d4-ab39-febe169378d1 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:49.864505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:49.865890 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:49.866413 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:49.867022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:49.891505 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.894506 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:49.903088 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:49.925180 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:49.949906 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd08bc5-ec9d-4c9f-9936-c44e0cb2392c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:49.951648 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd08bc5-ec9d-4c9f-9936-c44e0cb2392c service nova] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:49.963329 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1406/2818] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:20:50.000038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1413/2819] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:20:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:20:50.149090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:50.210357 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:50.600740 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:50.670699 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:50.922383 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:50.925801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:50.957689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a547aa-a2c5-4a1e-8b74-8d9bc1e313e8 service neutron] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:50.963244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:50.965447 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:50.966064 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:50.966589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] PATH_INFO: `/v3/projects/b5fe828c185c481fab1b7fac85299e1d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:50.968175 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5fe828c185c481fab1b7fac85299e1d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:50.972478 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:51.172778 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5fe828c185c481fab1b7fac85299e1d', 'request_id': 'req-34938377-21ac-4941-87c1-831472b26a0f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:51.267684 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5fe828c185c481fab1b7fac85299e1d', 'request_id': 'req-34938377-21ac-4941-87c1-831472b26a0f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:51.276081 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5fe828c185c481fab1b7fac85299e1d', 'request_id': 'req-34938377-21ac-4941-87c1-831472b26a0f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:51.304548 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] The token cache is being invalidate because project b5fe828c185c481fab1b7fac85299e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:20:51.311960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:51.311960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-34938377-21ac-4941-87c1-831472b26a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:20:51.311960 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1407/2820] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:20:50 2022] DELETE /identity/v3/projects/b5fe828c185c481fab1b7fac85299e1d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:20:51.588693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:51.664545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:51.856312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:52.053232 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:52.113887 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:52.433305 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:52.490685 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:53.071006 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:53.130772 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:53.913303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:54.127062 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:54.405026 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac318-f030-4aec-b092-2d392ab81119 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:54.405301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac318-f030-4aec-b092-2d392ab81119 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:54.405576 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac318-f030-4aec-b092-2d392ab81119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:54.445902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-f1fac318-f030-4aec-b092-2d392ab81119 None None] MFA Rules not processed for user `3a5d3ee1d06b4523be86123cf913d80b`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:54.446844 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-f1fac318-f030-4aec-b092-2d392ab81119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:54.526599 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:54.534312 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1414/2821] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:20:54.559249 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:54.766589 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:54.879503 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.005580 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.051474 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.205964 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.233851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.388222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.445455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.678424 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.829171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:55.973362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425013e-b79e-41a1-a09c-08781fcdbfbb None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:55.973652 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425013e-b79e-41a1-a09c-08781fcdbfbb None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:55.973991 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425013e-b79e-41a1-a09c-08781fcdbfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:55.995988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-c425013e-b79e-41a1-a09c-08781fcdbfbb None None] MFA Rules not processed for user `62c00554e5f64843a54c6ab5b04e5238`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:55.997237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-c425013e-b79e-41a1-a09c-08781fcdbfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:56.088874 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1408/2822] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:20:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:20:56.095804 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.152847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.245664 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.275178 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.359022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.424122 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70974-c727-475d-8f8d-ab7b42955ad5 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:56.424636 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70974-c727-475d-8f8d-ab7b42955ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:56.425012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb70974-c727-475d-8f8d-ab7b42955ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application [None req-3eb70974-c727-475d-8f8d-ab7b42955ad5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:20:56.433018 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:20:56.434183 dv-cinder-855013-1-smb devstack@keystone.service[81882]: ERROR keystone.server.flask.application Aug 29 19:20:56.435355 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1415/2823] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:20:56 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:20:56.446202 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.523617 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.621385 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.730186 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.787328 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.953029 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:56.981416 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.095635 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.159344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.290051 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.307162 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=100 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.341660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.358574 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.474201 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.536313 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.731044 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.815913 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:57.838324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:58.135872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:58.416454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:59.319980 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d983311-9b91-4c47-a748-a35b7f045859 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:59.320651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d983311-9b91-4c47-a748-a35b7f045859 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:59.320651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d983311-9b91-4c47-a748-a35b7f045859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:59.342197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-0d983311-9b91-4c47-a748-a35b7f045859 None None] MFA Rules not processed for user `59e8a8c6ca7549238eeab1a5ad74f896`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:20:59.343433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d983311-9b91-4c47-a748-a35b7f045859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:59.410355 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1409/2824] 10.222.0.82 () {58 vars in 967 bytes} [Mon Aug 29 19:20:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:20:59.445432 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb70974-c727-475d-8f8d-ab7b42955ad5 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:20:59.447893 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-3eb70974-c727-475d-8f8d-ab7b42955ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:20:59.546129 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb70974-c727-475d-8f8d-ab7b42955ad5 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:20:59.552540 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c560d81-ce8a-4473-9a1b-5803bb219af4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '209e9c8c1a0b41b58f51e94e4bd6c3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:20:59.553181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560d81-ce8a-4473-9a1b-5803bb219af4 service swift] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:20:59.553448 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560d81-ce8a-4473-9a1b-5803bb219af4 service swift] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:20:59.553726 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c560d81-ce8a-4473-9a1b-5803bb219af4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:20:59.560338 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=100 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:20:59.562856 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c560d81-ce8a-4473-9a1b-5803bb219af4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:20:59.564695 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c560d81-ce8a-4473-9a1b-5803bb219af4 service swift] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:20:59.574981 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1416/2825] 10.222.0.82 () {60 vars in 1384 bytes} [Mon Aug 29 19:20:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 19:21:00.519626 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d983311-9b91-4c47-a748-a35b7f045859 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:00.521261 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-0d983311-9b91-4c47-a748-a35b7f045859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:00.609095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d983311-9b91-4c47-a748-a35b7f045859 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:00.615251 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:00.616036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:00.616319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:00.616691 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] PATH_INFO: `/v3/users/7839321e9fd94ad8b75adf8555513db4` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:00.617953 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7839321e9fd94ad8b75adf8555513db4)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:00.620225 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:00.852884 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7839321e9fd94ad8b75adf8555513db4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:00.930448 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7839321e9fd94ad8b75adf8555513db4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:00.931077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7839321e9fd94ad8b75adf8555513db4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:00.946681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7839321e9fd94ad8b75adf8555513db4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:00.947508 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7839321e9fd94ad8b75adf8555513db4'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:00.963689 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1410/2826] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:21:00 2022] DELETE /identity/v3/users/7839321e9fd94ad8b75adf8555513db4 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:00.968619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61e6d-9f53-465e-adea-9e181d2e9a08 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:00.969168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61e6d-9f53-465e-adea-9e181d2e9a08 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:00.969168 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61e6d-9f53-465e-adea-9e181d2e9a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:00.991181 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6ed61e6d-9f53-465e-adea-9e181d2e9a08 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:00.992475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6ed61e6d-9f53-465e-adea-9e181d2e9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:01.066286 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1417/2827] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:21:01.073965 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:01.075457 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:01.092686 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:01.152832 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8e2d3-25bb-4929-8bf7-ca1a1714838e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:01.157056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b473de-54cb-4214-a760-9cfa7c09e2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:01.157703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b473de-54cb-4214-a760-9cfa7c09e2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:01.158049 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b473de-54cb-4214-a760-9cfa7c09e2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:01.159002 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b473de-54cb-4214-a760-9cfa7c09e2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:01.169660 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b473de-54cb-4214-a760-9cfa7c09e2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:01.171132 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b473de-54cb-4214-a760-9cfa7c09e2b2 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:01.183254 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1411/2828] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:01.785801 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed61e6d-9f53-465e-adea-9e181d2e9a08 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:01.787672 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6ed61e6d-9f53-465e-adea-9e181d2e9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:01.805043 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed61e6d-9f53-465e-adea-9e181d2e9a08 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:01.811487 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:01.812191 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:01.812473 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:01.812779 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] PATH_INFO: `/v3/projects/579ab134c2124f668dd0f55d4cbf4025` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:01.814145 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579ab134c2124f668dd0f55d4cbf4025)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:01.816220 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:01.960616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579ab134c2124f668dd0f55d4cbf4025', 'request_id': 'req-68496875-4393-4356-8154-f77469bdd6e9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:02.020978 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579ab134c2124f668dd0f55d4cbf4025', 'request_id': 'req-68496875-4393-4356-8154-f77469bdd6e9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:02.033743 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579ab134c2124f668dd0f55d4cbf4025', 'request_id': 'req-68496875-4393-4356-8154-f77469bdd6e9'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:02.054118 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] The token cache is being invalidate because project 579ab134c2124f668dd0f55d4cbf4025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:21:02.054455 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:02.055450 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-68496875-4393-4356-8154-f77469bdd6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:02.062461 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1418/2829] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:21:01 2022] DELETE /identity/v3/projects/579ab134c2124f668dd0f55d4cbf4025 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:02.076862 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123f7a2-db70-4d10-ad67-7c0ef823087c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.077456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123f7a2-db70-4d10-ad67-7c0ef823087c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.077456 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123f7a2-db70-4d10-ad67-7c0ef823087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.098839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-3123f7a2-db70-4d10-ad67-7c0ef823087c None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:02.100253 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-3123f7a2-db70-4d10-ad67-7c0ef823087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:02.169846 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1412/2830] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:02.179012 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2c3f-051a-4558-acda-0b0cad1e87ff None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.182690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2c3f-051a-4558-acda-0b0cad1e87ff None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.182690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc2c3f-051a-4558-acda-0b0cad1e87ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.215928 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-56cc2c3f-051a-4558-acda-0b0cad1e87ff None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:02.218231 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-56cc2c3f-051a-4558-acda-0b0cad1e87ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:02.232860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1419/2831] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:02.238319 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123f7a2-db70-4d10-ad67-7c0ef823087c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:02.248150 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123f7a2-db70-4d10-ad67-7c0ef823087c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:02.253298 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:02.254070 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.254351 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.254654 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.255522 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:21:02.255861 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:02.257469 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:02.270872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1413/2832] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:21:02.275307 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc2c3f-051a-4558-acda-0b0cad1e87ff None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:02.285187 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc2c3f-051a-4558-acda-0b0cad1e87ff None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:02.289882 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cda63-d9e1-45a3-acc9-3519c97c7fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:02.290616 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cda63-d9e1-45a3-acc9-3519c97c7fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.290902 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cda63-d9e1-45a3-acc9-3519c97c7fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.291174 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cda63-d9e1-45a3-acc9-3519c97c7fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.291830 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cda63-d9e1-45a3-acc9-3519c97c7fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:02.293732 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cda63-d9e1-45a3-acc9-3519c97c7fd0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:02.420160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1420/2833] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:21:02 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:21:02.427515 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:02.451285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ab836-4726-45bc-bcfe-0c45f7838bb1 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:02.557086 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a273-904f-442f-91e4-8edf073d7df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:02.557715 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a273-904f-442f-91e4-8edf073d7df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.557984 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a273-904f-442f-91e4-8edf073d7df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.558385 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999a273-904f-442f-91e4-8edf073d7df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.558889 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a273-904f-442f-91e4-8edf073d7df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:02.560875 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999a273-904f-442f-91e4-8edf073d7df6 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:02.651164 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1414/2834] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:21:02 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 19:21:02.652486 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cda63-d9e1-45a3-acc9-3519c97c7fd0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:02.665950 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cda63-d9e1-45a3-acc9-3519c97c7fd0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:02.672173 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf731-c06f-4fdb-9426-4e05e629c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:02.673815 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf731-c06f-4fdb-9426-4e05e629c048 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.674940 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf731-c06f-4fdb-9426-4e05e629c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.675342 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf731-c06f-4fdb-9426-4e05e629c048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.677140 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdf731-c06f-4fdb-9426-4e05e629c048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:02.681793 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdf731-c06f-4fdb-9426-4e05e629c048 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:02.700230 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1421/2835] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:21:02.701805 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a273-904f-442f-91e4-8edf073d7df6 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:02.714836 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999a273-904f-442f-91e4-8edf073d7df6 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:02.724144 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b85690-157e-4356-aafc-91f44d9d603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:02.724882 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b85690-157e-4356-aafc-91f44d9d603e admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.725260 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b85690-157e-4356-aafc-91f44d9d603e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.725745 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b85690-157e-4356-aafc-91f44d9d603e admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.726638 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b85690-157e-4356-aafc-91f44d9d603e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:02.729459 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b85690-157e-4356-aafc-91f44d9d603e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:02.754111 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1415/2836] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 19:21:02.758038 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf731-c06f-4fdb-9426-4e05e629c048 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:02.770556 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf731-c06f-4fdb-9426-4e05e629c048 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:02.775419 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:02.776216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.776685 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.777030 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] PATH_INFO: `/v3/projects/097a029fc7474c2b91797f89d2fe44ac/users/c941d69e39cf40a18780a15667075fd8/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.793068 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097a029fc7474c2b91797f89d2fe44ac, user_id=c941d69e39cf40a18780a15667075fd8, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:02.795806 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:02.889812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1422/2837] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:21:02 2022] PUT /identity/v3/projects/097a029fc7474c2b91797f89d2fe44ac/users/c941d69e39cf40a18780a15667075fd8/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:02.901741 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c139-6c60-4e92-b7b6-34fa5b511e72 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:02.902039 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c139-6c60-4e92-b7b6-34fa5b511e72 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:02.902324 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475c139-6c60-4e92-b7b6-34fa5b511e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:02.957494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-4475c139-6c60-4e92-b7b6-34fa5b511e72 None None] MFA Rules not processed for user `c941d69e39cf40a18780a15667075fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:02.960681 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4475c139-6c60-4e92-b7b6-34fa5b511e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:02.982295 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:03.055770 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1416/2838] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:21:03.078344 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:03.081395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:03.106657 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:03.160322 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91e8c-1e27-48c9-8411-4bf335a938a0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:03.164589 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5df7aa-80a0-4029-b753-7f41d727b863 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5786ad6388c54a3f82955e12e8e8f8b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:03.165519 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df7aa-80a0-4029-b753-7f41d727b863 service glance] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:03.165869 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df7aa-80a0-4029-b753-7f41d727b863 service glance] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:03.166211 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df7aa-80a0-4029-b753-7f41d727b863 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:03.177021 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5df7aa-80a0-4029-b753-7f41d727b863 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:03.178814 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5df7aa-80a0-4029-b753-7f41d727b863 service glance] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:03.194169 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1423/2839] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:08.771397 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475c139-6c60-4e92-b7b6-34fa5b511e72 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:08.773042 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4475c139-6c60-4e92-b7b6-34fa5b511e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:08.843330 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475c139-6c60-4e92-b7b6-34fa5b511e72 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:08.848610 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:08.849243 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:08.849520 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:08.849789 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] PATH_INFO: `/v3/users/62c00554e5f64843a54c6ab5b04e5238` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:08.850904 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c00554e5f64843a54c6ab5b04e5238)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:08.852858 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:09.213380 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c00554e5f64843a54c6ab5b04e5238'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.301799 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c00554e5f64843a54c6ab5b04e5238'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.302454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c00554e5f64843a54c6ab5b04e5238'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.324114 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c00554e5f64843a54c6ab5b04e5238'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.325284 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c00554e5f64843a54c6ab5b04e5238'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.352100 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1417/2840] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:21:08 2022] DELETE /identity/v3/users/62c00554e5f64843a54c6ab5b04e5238 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:09.673970 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5df7aa-80a0-4029-b753-7f41d727b863 service glance] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:09.688086 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5df7aa-80a0-4029-b753-7f41d727b863 service glance] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:09.768424 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:09.769171 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:09.769518 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:09.769870 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] PATH_INFO: `/v3/projects/70dc3e2c991f4f0b81e3c5dbb3601448` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:09.771206 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70dc3e2c991f4f0b81e3c5dbb3601448)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:09.773258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:09.884208 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70dc3e2c991f4f0b81e3c5dbb3601448', 'request_id': 'req-88389985-bdf8-4c72-b00d-3b95f6fc26d0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.935430 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70dc3e2c991f4f0b81e3c5dbb3601448', 'request_id': 'req-88389985-bdf8-4c72-b00d-3b95f6fc26d0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.943557 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70dc3e2c991f4f0b81e3c5dbb3601448', 'request_id': 'req-88389985-bdf8-4c72-b00d-3b95f6fc26d0'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.954377 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] The token cache is being invalidate because project 70dc3e2c991f4f0b81e3c5dbb3601448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:21:09.954674 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.956725 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:09.958258 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1424/2841] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:21:09 2022] DELETE /identity/v3/projects/70dc3e2c991f4f0b81e3c5dbb3601448 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:09.962441 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:09.967160 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:09.977688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757706ef-46e6-426d-aa0b-1942869dc506 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:10.010419 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:10.038634 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:10.039272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:10.039559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:10.039872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] PATH_INFO: `/v3/users/208bd5f166dd44aca9e5f66fd29b2e1f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:10.041080 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208bd5f166dd44aca9e5f66fd29b2e1f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:10.043035 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:10.230187 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208bd5f166dd44aca9e5f66fd29b2e1f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.285154 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208bd5f166dd44aca9e5f66fd29b2e1f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.285765 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208bd5f166dd44aca9e5f66fd29b2e1f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.298452 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208bd5f166dd44aca9e5f66fd29b2e1f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.299270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208bd5f166dd44aca9e5f66fd29b2e1f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.311655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1418/2842] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:21:09 2022] DELETE /identity/v3/users/208bd5f166dd44aca9e5f66fd29b2e1f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:10.577047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:10.581668 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:10.591663 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88389985-bdf8-4c72-b00d-3b95f6fc26d0 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:10.649082 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:10.661853 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:10.662506 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:10.667632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:10.667632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] PATH_INFO: `/v3/projects/2a29d95e129b400586fcc716444d42fd` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:10.667632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a29d95e129b400586fcc716444d42fd)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:10.667632 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:10.792754 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a29d95e129b400586fcc716444d42fd', 'request_id': 'req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.862914 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a29d95e129b400586fcc716444d42fd', 'request_id': 'req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.872090 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a29d95e129b400586fcc716444d42fd', 'request_id': 'req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.886662 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] The token cache is being invalidate because project 2a29d95e129b400586fcc716444d42fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:21:10.886965 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.887635 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-7ed28cac-61c7-44dd-9f31-9d8f48dd304b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:10.889162 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1425/2843] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:21:10 2022] DELETE /identity/v3/projects/2a29d95e129b400586fcc716444d42fd => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:14.860199 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:14.862479 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:14.875272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a82b9-0518-4654-8d19-dce10c249423 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:14.938856 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:14.940607 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:14.941007 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:14.946069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] PATH_INFO: `/v3/users/3ff3eb8b29c348989c100ed8d4292c08` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:14.946069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ff3eb8b29c348989c100ed8d4292c08)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:14.946069 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:15.086197 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ff3eb8b29c348989c100ed8d4292c08'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:15.089812 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:15.135273 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ff3eb8b29c348989c100ed8d4292c08'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:15.135876 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ff3eb8b29c348989c100ed8d4292c08'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:15.150095 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ff3eb8b29c348989c100ed8d4292c08'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:15.151055 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ff3eb8b29c348989c100ed8d4292c08'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:15.165636 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1419/2844] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:21:14 2022] DELETE /identity/v3/users/3ff3eb8b29c348989c100ed8d4292c08 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:15.170186 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc421e-e396-4a79-8c96-6e67cf4a59ae None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:15.170670 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc421e-e396-4a79-8c96-6e67cf4a59ae None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:15.170786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc421e-e396-4a79-8c96-6e67cf4a59ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:15.194029 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-43dc421e-e396-4a79-8c96-6e67cf4a59ae None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:15.195693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-43dc421e-e396-4a79-8c96-6e67cf4a59ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:15.264688 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1426/2845] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:15.275263 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:15.276839 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:15.341161 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f55e01-ad65-4f2c-999d-bb253ff23d89 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:15.344962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa6271-4dd3-4a6c-a9e4-832b5137494a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:15.345651 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa6271-4dd3-4a6c-a9e4-832b5137494a service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:15.346191 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa6271-4dd3-4a6c-a9e4-832b5137494a service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:15.346860 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa6271-4dd3-4a6c-a9e4-832b5137494a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:15.358022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa6271-4dd3-4a6c-a9e4-832b5137494a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:15.359451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa6271-4dd3-4a6c-a9e4-832b5137494a service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:15.369611 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1420/2846] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:15.824537 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc421e-e396-4a79-8c96-6e67cf4a59ae None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:15.826566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-43dc421e-e396-4a79-8c96-6e67cf4a59ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:15.843429 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc421e-e396-4a79-8c96-6e67cf4a59ae None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:15.850036 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:15.851800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:15.851800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:15.851800 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] PATH_INFO: `/v3/projects/81627970d2354f268b26ba44a4897049` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:15.853180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81627970d2354f268b26ba44a4897049)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:15.855375 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:16.024105 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81627970d2354f268b26ba44a4897049', 'request_id': 'req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:16.118311 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81627970d2354f268b26ba44a4897049', 'request_id': 'req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:16.125112 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81627970d2354f268b26ba44a4897049', 'request_id': 'req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:16.139210 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] The token cache is being invalidate because project 81627970d2354f268b26ba44a4897049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:21:16.139584 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:16.140983 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:16.143807 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1427/2847] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:21:15 2022] DELETE /identity/v3/projects/81627970d2354f268b26ba44a4897049 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:18.172913 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ee4e-3297-427d-8970-d6721e7a7828 None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:18.173491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ee4e-3297-427d-8970-d6721e7a7828 None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:18.173491 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ee4e-3297-427d-8970-d6721e7a7828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application [None req-4f37ee4e-3297-427d-8970-d6721e7a7828 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 19:21:18.180215 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 29 19:21:18.181321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: ERROR keystone.server.flask.application Aug 29 19:21:18.182372 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1421/2848] 10.222.0.82 () {58 vars in 1009 bytes} [Mon Aug 29 19:21:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 29 19:21:25.365270 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=38,keystone:DELETE=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:26.072736 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:26.074363 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:26.079468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:26.141389 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0f71-3f09-4218-9b9e-a8b5d9de87b7 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:26.151742 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:26.152401 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:26.152678 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:26.152951 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] PATH_INFO: `/v3/users/3a5d3ee1d06b4523be86123cf913d80b` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:26.154111 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5d3ee1d06b4523be86123cf913d80b)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:26.156108 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:26.344444 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5d3ee1d06b4523be86123cf913d80b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:26.345106 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5d3ee1d06b4523be86123cf913d80b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:26.404065 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5d3ee1d06b4523be86123cf913d80b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:26.404622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5d3ee1d06b4523be86123cf913d80b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:26.418143 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5d3ee1d06b4523be86123cf913d80b'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:26.430792 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1428/2849] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:21:26 2022] DELETE /identity/v3/users/3a5d3ee1d06b4523be86123cf913d80b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:26.828671 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37ee4e-3297-427d-8970-d6721e7a7828 None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:26.831083 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-4f37ee4e-3297-427d-8970-d6721e7a7828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:26.907494 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37ee4e-3297-427d-8970-d6721e7a7828 None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:26.913763 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:26.914411 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:26.914688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:26.914959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] PATH_INFO: `/v3/projects/c31b71e3038242328b1771492db2f17f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:26.916128 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31b71e3038242328b1771492db2f17f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:26.918022 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:27.060946 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31b71e3038242328b1771492db2f17f', 'request_id': 'req-893fd3c3-e2c6-4835-943f-aab000704b8f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.158775 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31b71e3038242328b1771492db2f17f', 'request_id': 'req-893fd3c3-e2c6-4835-943f-aab000704b8f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.166233 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31b71e3038242328b1771492db2f17f', 'request_id': 'req-893fd3c3-e2c6-4835-943f-aab000704b8f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.178898 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] The token cache is being invalidate because project c31b71e3038242328b1771492db2f17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:21:27.179188 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.180121 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.181551 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1422/2850] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:21:26 2022] DELETE /identity/v3/projects/c31b71e3038242328b1771492db2f17f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:27.185749 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:27.201302 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970203d3-420c-4400-b11d-aa38ec87cfaf admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:27.269001 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:27.269860 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:27.270147 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:27.270421 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] PATH_INFO: `/v3/users/05761129815b49ada417b947669a6c26` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:27.271577 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05761129815b49ada417b947669a6c26)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:27.273573 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:27.296654 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:27.465255 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05761129815b49ada417b947669a6c26'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.465973 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05761129815b49ada417b947669a6c26'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.558463 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05761129815b49ada417b947669a6c26'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.559146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05761129815b49ada417b947669a6c26'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.572705 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05761129815b49ada417b947669a6c26'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:27.586468 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1429/2851] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:21:27 2022] DELETE /identity/v3/users/05761129815b49ada417b947669a6c26 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:27.846912 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:27.849118 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:27.866190 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fd3c3-e2c6-4835-943f-aab000704b8f admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:27.927303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:27.927993 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:27.928283 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:27.928559 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] PATH_INFO: `/v3/projects/b9ee2ad1ebb84545bc0ac7c50943a88d` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:27.929801 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ee2ad1ebb84545bc0ac7c50943a88d)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:27.931753 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:28.108585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:28.121545 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ee2ad1ebb84545bc0ac7c50943a88d', 'request_id': 'req-d273152b-3997-4c77-8a1c-c36d119b92c5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:28.238943 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ee2ad1ebb84545bc0ac7c50943a88d', 'request_id': 'req-d273152b-3997-4c77-8a1c-c36d119b92c5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:28.246616 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ee2ad1ebb84545bc0ac7c50943a88d', 'request_id': 'req-d273152b-3997-4c77-8a1c-c36d119b92c5'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:28.259585 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] The token cache is being invalidate because project b9ee2ad1ebb84545bc0ac7c50943a88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81883) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:21:28.259919 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:28.260645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:28.262222 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1423/2852] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:21:27 2022] DELETE /identity/v3/projects/b9ee2ad1ebb84545bc0ac7c50943a88d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:33.679810 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:33.681379 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:33.758526 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d74bc-2e76-4704-930c-5b32ba789099 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:33.818566 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b47886-cddc-4dac-ac70-4b21fe18748c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abf58a62bd2e4139965fc25a4f9c6161', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:33.819180 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47886-cddc-4dac-ac70-4b21fe18748c service placement] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:33.819467 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47886-cddc-4dac-ac70-4b21fe18748c service placement] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:33.819767 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b47886-cddc-4dac-ac70-4b21fe18748c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:33.821550 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-39b47886-cddc-4dac-ac70-4b21fe18748c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:33.833472 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47886-cddc-4dac-ac70-4b21fe18748c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:33.835047 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b47886-cddc-4dac-ac70-4b21fe18748c service placement] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:33.845160 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1430/2853] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:21:35.552779 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:35.554377 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:35.622633 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273152b-3997-4c77-8a1c-c36d119b92c5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:35.627362 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:35.628028 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:35.628305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:35.628578 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] PATH_INFO: `/v3/users/c941d69e39cf40a18780a15667075fd8` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:35.629703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c941d69e39cf40a18780a15667075fd8)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:35.631603 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:35.817851 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c941d69e39cf40a18780a15667075fd8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:35.894798 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c941d69e39cf40a18780a15667075fd8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:35.895454 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c941d69e39cf40a18780a15667075fd8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:35.909061 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c941d69e39cf40a18780a15667075fd8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:35.909752 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c941d69e39cf40a18780a15667075fd8'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:35.933350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1424/2854] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:21:35 2022] DELETE /identity/v3/users/c941d69e39cf40a18780a15667075fd8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:35.938257 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c637bad-ec21-474c-bd9c-a170a6ff325d None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:35.938802 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c637bad-ec21-474c-bd9c-a170a6ff325d None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:35.938957 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c637bad-ec21-474c-bd9c-a170a6ff325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:35.963030 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-6c637bad-ec21-474c-bd9c-a170a6ff325d None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:35.964398 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6c637bad-ec21-474c-bd9c-a170a6ff325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:35.997498 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:36.027161 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1431/2855] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 19:21:36.037918 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:36.039348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:36.088313 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:36.103939 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb38ed8-d9c1-47b4-9fdc-dceba63fb561 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:36.108348 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4890b9c-06ac-4488-b62f-497c404efba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:36.108988 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4890b9c-06ac-4488-b62f-497c404efba9 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:36.109285 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4890b9c-06ac-4488-b62f-497c404efba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:36.109565 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4890b9c-06ac-4488-b62f-497c404efba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:36.121089 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4890b9c-06ac-4488-b62f-497c404efba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:36.122914 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4890b9c-06ac-4488-b62f-497c404efba9 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:36.135407 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1425/2856] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:36.576873 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c637bad-ec21-474c-bd9c-a170a6ff325d None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:36.578417 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-6c637bad-ec21-474c-bd9c-a170a6ff325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:36.591326 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c637bad-ec21-474c-bd9c-a170a6ff325d None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:36.596391 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:36.597221 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:36.597504 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:36.597845 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] PATH_INFO: `/v3/projects/097a029fc7474c2b91797f89d2fe44ac` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:36.599799 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=097a029fc7474c2b91797f89d2fe44ac)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:36.601045 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:36.725737 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097a029fc7474c2b91797f89d2fe44ac', 'request_id': 'req-120c741d-be5b-445e-b1b1-551cc1964e79'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:36.820826 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097a029fc7474c2b91797f89d2fe44ac', 'request_id': 'req-120c741d-be5b-445e-b1b1-551cc1964e79'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:36.827693 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097a029fc7474c2b91797f89d2fe44ac', 'request_id': 'req-120c741d-be5b-445e-b1b1-551cc1964e79'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:36.838362 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] The token cache is being invalidate because project 097a029fc7474c2b91797f89d2fe44ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:21:36.838646 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:36.839285 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-120c741d-be5b-445e-b1b1-551cc1964e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:36.840812 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1432/2857] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:21:36 2022] DELETE /identity/v3/projects/097a029fc7474c2b91797f89d2fe44ac => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:36.846305 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab902-8903-445c-ade5-26094d68c26e None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:36.846796 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab902-8903-445c-ade5-26094d68c26e None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:36.847060 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ab902-8903-445c-ade5-26094d68c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:36.868072 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-1b3ab902-8903-445c-ade5-26094d68c26e None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:36.869303 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-1b3ab902-8903-445c-ade5-26094d68c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:36.931433 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1426/2858] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:36.939847 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379267a-43c0-48d7-8822-c061eb797b00 None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:36.940546 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379267a-43c0-48d7-8822-c061eb797b00 None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:36.941114 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379267a-43c0-48d7-8822-c061eb797b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:36.964817 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-1379267a-43c0-48d7-8822-c061eb797b00 None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:36.969561 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-1379267a-43c0-48d7-8822-c061eb797b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:36.977466 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1433/2859] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:36.981077 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ab902-8903-445c-ade5-26094d68c26e None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:36.991444 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ab902-8903-445c-ade5-26094d68c26e None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:36.996056 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:36.996703 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:36.996986 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:36.997262 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:36.997941 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81883) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 19:21:36.998246 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:36.999872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:37.012321 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1427/2860] 10.222.0.82 () {58 vars in 1153 bytes} [Mon Aug 29 19:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 19:21:37.017003 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379267a-43c0-48d7-8822-c061eb797b00 None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:37.027059 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379267a-43c0-48d7-8822-c061eb797b00 None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:37.031968 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fa7a2-a419-47f2-9b37-1d63e78087fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:37.032578 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa7a2-a419-47f2-9b37-1d63e78087fa admin admin] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:37.032911 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa7a2-a419-47f2-9b37-1d63e78087fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:37.033182 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fa7a2-a419-47f2-9b37-1d63e78087fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:37.033825 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fa7a2-a419-47f2-9b37-1d63e78087fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:37.035764 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fa7a2-a419-47f2-9b37-1d63e78087fa admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:37.154096 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1434/2861] 10.222.0.82 () {60 vars in 1153 bytes} [Mon Aug 29 19:21:37 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:21:37.158569 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:37.168648 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3c94a-2187-44ef-b5ca-378d45f4c1e5 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:37.226451 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d9d1b-8bef-4332-8d09-33fc65bc0d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:37.227690 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d9d1b-8bef-4332-8d09-33fc65bc0d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:37.227959 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d9d1b-8bef-4332-8d09-33fc65bc0d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:37.228240 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d9d1b-8bef-4332-8d09-33fc65bc0d6e admin admin] PATH_INFO: `/v3/users` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:37.228872 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d9d1b-8bef-4332-8d09-33fc65bc0d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:37.231048 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d9d1b-8bef-4332-8d09-33fc65bc0d6e admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:37.341863 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1428/2862] 10.222.0.82 () {60 vars in 1144 bytes} [Mon Aug 29 19:21:37 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 19:21:37.346925 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fa7a2-a419-47f2-9b37-1d63e78087fa admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:37.357762 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fa7a2-a419-47f2-9b37-1d63e78087fa admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:37.362690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b1bcc-fc6a-4b63-bf4b-aa97180adb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:37.363301 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b1bcc-fc6a-4b63-bf4b-aa97180adb63 admin admin] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:37.363580 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b1bcc-fc6a-4b63-bf4b-aa97180adb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:37.363890 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b1bcc-fc6a-4b63-bf4b-aa97180adb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:37.364559 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b1bcc-fc6a-4b63-bf4b-aa97180adb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:37.366189 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b1bcc-fc6a-4b63-bf4b-aa97180adb63 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:37.376879 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1435/2863] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:21:37.381688 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d9d1b-8bef-4332-8d09-33fc65bc0d6e admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:37.391899 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d9d1b-8bef-4332-8d09-33fc65bc0d6e admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:37.397505 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e4c91-b6ed-4bed-9cda-cf4e2fc3b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:37.398094 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4c91-b6ed-4bed-9cda-cf4e2fc3b2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:37.398373 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4c91-b6ed-4bed-9cda-cf4e2fc3b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:37.398645 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e4c91-b6ed-4bed-9cda-cf4e2fc3b2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:37.399279 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e4c91-b6ed-4bed-9cda-cf4e2fc3b2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:37.400962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e4c91-b6ed-4bed-9cda-cf4e2fc3b2e7 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:37.412542 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1429/2864] 10.222.0.82 () {58 vars in 1122 bytes} [Mon Aug 29 19:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 19:21:37.417069 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b1bcc-fc6a-4b63-bf4b-aa97180adb63 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:37.428402 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b1bcc-fc6a-4b63-bf4b-aa97180adb63 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:37.433216 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:37.433868 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:37.434157 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:37.434434 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] PATH_INFO: `/v3/projects/3bf390fb91e845449ed7f5a3cbdf2ebb/users/d2eacb1b9bec48e8bd876ae2cf41835f/roles/cf033ca534d941b5b3284c687e715647` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:37.449619 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf390fb91e845449ed7f5a3cbdf2ebb, user_id=d2eacb1b9bec48e8bd876ae2cf41835f, role_id=cf033ca534d941b5b3284c687e715647)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:37.452292 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:37.529786 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1436/2865] 10.222.0.82 () {60 vars in 1483 bytes} [Mon Aug 29 19:21:37 2022] PUT /identity/v3/projects/3bf390fb91e845449ed7f5a3cbdf2ebb/users/d2eacb1b9bec48e8bd876ae2cf41835f/roles/cf033ca534d941b5b3284c687e715647 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 19:21:37.542350 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59846f3-70ec-42f1-865a-9d9818483c8c None None] REQUEST_METHOD: `POST` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:37.542655 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59846f3-70ec-42f1-865a-9d9818483c8c None None] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:37.542928 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59846f3-70ec-42f1-865a-9d9818483c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:37.572272 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.auth.core [None req-f59846f3-70ec-42f1-865a-9d9818483c8c None None] MFA Rules not processed for user `d2eacb1b9bec48e8bd876ae2cf41835f`. Rule list: `[]` (Enabled: `True`). {{(pid=81883) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:37.573527 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-f59846f3-70ec-42f1-865a-9d9818483c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:37.613359 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:37.639396 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1430/2866] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:37.651481 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:37.653224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:37.712146 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353cecae-587b-4f53-b9d0-107a155eaa58 admin admin] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:37.715771 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956707b-f6c5-4c4c-b716-8b6355222dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b55bbe406a04cf28244380f5b07eed9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:37.716384 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956707b-f6c5-4c4c-b716-8b6355222dae service cinder] REQUEST_METHOD: `GET` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:37.716682 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956707b-f6c5-4c4c-b716-8b6355222dae service cinder] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:37.716960 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956707b-f6c5-4c4c-b716-8b6355222dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:37.723967 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:37.726200 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956707b-f6c5-4c4c-b716-8b6355222dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:37.727622 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956707b-f6c5-4c4c-b716-8b6355222dae service cinder] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:37.737224 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1437/2867] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 19:21:47.672182 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=10 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:47.866475 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=2 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:21:49.562045 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59846f3-70ec-42f1-865a-9d9818483c8c None None] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:49.626335 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59846f3-70ec-42f1-865a-9d9818483c8c None None] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:49.632046 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:49.632682 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:49.632966 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:49.633244 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] PATH_INFO: `/v3/users/d2eacb1b9bec48e8bd876ae2cf41835f` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:49.634366 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2eacb1b9bec48e8bd876ae2cf41835f)` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:49.636439 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:49.812828 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2eacb1b9bec48e8bd876ae2cf41835f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:49.923905 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2eacb1b9bec48e8bd876ae2cf41835f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:49.924553 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2eacb1b9bec48e8bd876ae2cf41835f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:49.937962 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2eacb1b9bec48e8bd876ae2cf41835f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:49.938619 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.notifications [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2eacb1b9bec48e8bd876ae2cf41835f'} {{(pid=81883) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:49.951292 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1431/2868] 10.222.0.82 () {58 vars in 1224 bytes} [Mon Aug 29 19:21:49 2022] DELETE /identity/v3/users/d2eacb1b9bec48e8bd876ae2cf41835f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:21:49.955765 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013093e-b231-44b5-b735-20cf0c1d3c6a None None] REQUEST_METHOD: `POST` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:49.956849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013093e-b231-44b5-b735-20cf0c1d3c6a None None] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:49.956849 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013093e-b231-44b5-b735-20cf0c1d3c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:49.976660 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.auth.core [None req-c013093e-b231-44b5-b735-20cf0c1d3c6a None None] MFA Rules not processed for user `094bda4debcf4532ab8f582465d0a41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81882) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 19:21:49.977881 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c013093e-b231-44b5-b735-20cf0c1d3c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:50.037839 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1438/2869] 10.222.0.82 () {58 vars in 958 bytes} [Mon Aug 29 19:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 19:21:50.047800 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] Authenticating user token {{(pid=81883) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:50.049237 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.fernet_utils [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81883) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:50.121870 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46859b-23a4-4f83-ad23-a9f186b89c61 admin admin] Validating token access rules against request {{(pid=81883) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:50.130732 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14feb8-2e79-46a9-be62-e23129f8b8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '218e551387574808b225e73b766b5062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'caadbe20d144460b92663c1feb48977a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81883) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:50.131349 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14feb8-2e79-46a9-be62-e23129f8b8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:50.131631 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14feb8-2e79-46a9-be62-e23129f8b8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:50.131949 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14feb8-2e79-46a9-be62-e23129f8b8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81883) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:50.148453 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14feb8-2e79-46a9-be62-e23129f8b8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:50.150036 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14feb8-2e79-46a9-be62-e23129f8b8f0 service neutron] RBAC: Authorization granted {{(pid=81883) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:50.162183 dv-cinder-855013-1-smb devstack@keystone.service[81883]: [pid: 81883|app: 0|req: 1432/2870] 10.222.0.82 () {60 vars in 1365 bytes} [Mon Aug 29 19:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 19:21:50.583492 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013093e-b231-44b5-b735-20cf0c1d3c6a None None] Authenticating user token {{(pid=81882) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 19:21:50.588395 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.fernet_utils [None req-c013093e-b231-44b5-b735-20cf0c1d3c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81882) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 19:21:50.600997 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013093e-b231-44b5-b735-20cf0c1d3c6a None None] Validating token access rules against request {{(pid=81882) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 19:21:50.608591 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '094bda4debcf4532ab8f582465d0a41a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6563c9a51480471196235c4b00b7535a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81882) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 19:21:50.622926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 19:21:50.622926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 19:21:50.622926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] PATH_INFO: `/v3/projects/3bf390fb91e845449ed7f5a3cbdf2ebb` {{(pid=81882) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 19:21:50.622926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf390fb91e845449ed7f5a3cbdf2ebb)` {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 19:21:50.622926 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] RBAC: Authorization granted {{(pid=81882) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 19:21:50.761094 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf390fb91e845449ed7f5a3cbdf2ebb', 'request_id': 'req-1611add1-f10d-4e30-842e-619044cbca24'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:50.849690 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf390fb91e845449ed7f5a3cbdf2ebb', 'request_id': 'req-1611add1-f10d-4e30-842e-619044cbca24'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:50.856774 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf390fb91e845449ed7f5a3cbdf2ebb', 'request_id': 'req-1611add1-f10d-4e30-842e-619044cbca24'} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:50.867441 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] The token cache is being invalidate because project 3bf390fb91e845449ed7f5a3cbdf2ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81882) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 19:21:50.867750 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:50.868422 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG keystone.notifications [None req-1611add1-f10d-4e30-842e-619044cbca24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81882) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 19:21:50.869943 dv-cinder-855013-1-smb devstack@keystone.service[81882]: [pid: 81882|app: 0|req: 1439/2871] 10.222.0.82 () {58 vars in 1233 bytes} [Mon Aug 29 19:21:50 2022] DELETE /identity/v3/projects/3bf390fb91e845449ed7f5a3cbdf2ebb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 19:22:00.156443 dv-cinder-855013-1-smb devstack@keystone.service[81883]: DEBUG dbcounter [-] [81883] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81883) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:22:00.864403 dv-cinder-855013-1-smb devstack@keystone.service[81882]: DEBUG dbcounter [-] [81882] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81882) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}